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Chapter  1 

Introduction 


In  this  report,  we  address  the  general  problem  of  designing  controllers  that  minimize  the 
maximum  peak-to-peak  gain,  otherwise  known  as  the  tx  optimal  control  problem,  in  the 
presence  of  structured  imcertainty.  Four  different  problems  are  discussed: 

1.  Controller  design  in  the  presence  of  structured  uncertainty  with  a  general  discussion 
on  the  synthesis  of  lx  optimal  controllers. 

2.  The  lx  State-feedback  problem. 

3.  The  advantages  of  nonlinear  controllers  in  minimizing  the  l^  induced  norm. 

4.  Peak-to-Peak  performance  for  slowly  varying  systems. 

These  problems  are  addressed  in  the  following  four  chapters.  Chapter  1  is  taken 
from  the  paper  written  by  Deihleh  and  Khammsh  [8],  Chapter  2  is  taken  from  the  paper 
written  by  Diaz-Bobillo  and  Dahleh  [23],  Chapter  3  is  taken  from  the  paper  written 
by  Dahleh  and  Shamma  [14]  and  finally  Chapter  4  is  taken  from  the  paper  written  by 
Voulgaris,  Dahleh  sind  Valaveini  [59]. 
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Chapter  2 

Robust  Controller  Design  in  the 
presence  of  Structured 
Uncertainty 


This  chapter  addresses  the  problem  of  designing  feedback  controllers  to  achieve  good 
performance  in  the  presence  of  structured  plant  uncertainty  and  bounded  but  unknown 
disturbances.  A  general  formulation  for  the  performance  robustness  problem  is  presented 
and  exact  computable  conditions  are  furnished.  These  conditions  are  then  utilized  for 
synthesizing  robust  controllers  which  involves  solving  tx  optimization  problems.  These 
solutions  are  computed  using  the  duality  theory  of  Lagrange  multipliers.  Approximations 
and  computationeil  issues  are  discussed. 

2.1  Introduction 

The  objective  of  Robust  Control  is  to  provide  in  a  quantitative  way  the  fundamentzd 
limitations  and  capabilities  of  controller  design  in  order  to  achieve  good  performance 
requirements  m  the  presence  of  uncertainty.  Even  though  a  real  system  is  not  tmcertain, 
it  is  desirable  to  think  of  it  as  such  to  reflect  our  imprecise  or  partial  knowledge  of  its 
dynamics.  On  the  other  hand,  uncertainty  in  the  noise  and  disturbances  can  be  cast 
under  “real  uncertainties,”  as  it  is  practically  impossible  to  provide  exact  models  for 
such  inputs. 

Many  of  the  design  specifications  tend  to  be  concerned  with  amplitudes  of  signals.  For 
instance,  tracking,  disturbance  rejection,  actuator  authority,  all  result  in  specifications 
concerning  the  maximum  amplitudes  of  signals.  On  the  other  hand,  disturbances  and 
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noise  axe  usually  persistentj  boundedj  otherwise  unknown;  This  environment  motivates 
a  Peak-to-Peak  kind  of  spediicationsj  which  is  the  theme  of  the  l\  theory; 

In  this  chapter,  a  general  framework  for  designing  controllers  that  achieve  robust 
Peak-to-Peak  performance  in  the  presence  of  plant  perturbations  is  presented.  First, 
computable  necessary  and  sufficient  conditions  for  performance  robustness  are  presented; 
The  connections  between  these  conditions  and  spectral  properties  of  positive  matrices 
are  highlighted  and  utilized  to  simplify  the  computations.  These  conditions  are  in  turn 
used  for  the  synthesis  problem  which  will  involve  iterative  solutions  of  li  minimization 
problems,  the  solution  of  which  is  obtained  by  using  the  dusdity  theory  of  Lagrange 
multipliers. 

The  li  problem,  formtdated  in  [58],  was  solved  in  [10,  11].  The  theory  was  further 
developed  in  [17,  23,  24,  45,  54,  55].  The  robust  stabilization  problem  in  the  presence 
of  ^oo-stable  perturbations  was  first  analyzed  in  [9]  in  the  case  of  unstructured  perttir- 
bations.  In  [32],  a  performance  objective  was  added  to  the  robust  stability  reqmrement 
in  the  imstructured  perturbations  case  eind  conditions  were  provided  for  robust  per¬ 
formance  and  stability.  This  led  the  way  to  the  development  of  exact  necessary  and 
sufficient  conditions  for  robust  performance  in  the  presence  of  structured  perturbations 
[33,  34,  35].  Most  of  the  above  results  have  continuous-time  analogs. 

There  are  a  ntimber  of  contributions  in  this  chapter.  On  one  hand,  it  presents  a  uni¬ 
fied  framework  for  designing  robust  controllers  in  the  presence  of  structured  tmcertainty. 
Non- conservative  conditions  to  guarantee  robust  performance  are  developed  directly  in 
terms  of  the  spectral  radius  of  certain  matrices  capttiring  the  structure  of  the  perturba¬ 
tions.  Exact  relations  between  these  conditions  and  linear  matrix  inequality  conditions 
are  then  established.  On  the  other  hand,  the  use  of  linear  programming  in  synthesiz¬ 
ing  robust  controllers  is  highlighted  through  the  application  of  the  theory  of  Lagrange 
multipliers.  Through  this  simple  formulation,  problems  that  admit  a  finite-dimensional 
equivalence  become  quite  transparent.  For  the  rest  of  the  problems,  the  theory  proves  to 
be  quite  instrumental  in  providing  upper  and  lower  approximations  of  the  exact  problem. 

This  chapter  puts  together  aU  of  the  above  development  in  a  way  that  makes  the 
theory  readily  usable  for  design.  In  general,  details  that  appeared  elsewhere  will  not  be 
presented,  however,  simple  and  intuitive  proofs  of  the  main  ideas  wiU  be.  Shnilarities 
and  contrasts  between  this  theory  and  the  fi  formalism  will  also  be  highlighted. 
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2.2  Preliminaries 


First,  some  notation  regarding  stsmdard  concepts  for  input/output  systems.  For  more 
details,  consult  [18,  60]  and  references  therein. 

•  ^oo  denotes  the  set  of  all  sequences  /  =  {/o,  /i,  /z,  •  •  •}>  fk  6  so  that 

where  |/(fc)|oo  is  the  standard  lex,  norm  on  vectors.  Also,  lao,e  denotes  the  extended 
space  of  aU  sequences  in  and  loo,e\^oo  denotes  the  set  difference. 

•  ip,pe[i,  00 ),  denotes  the  set  of  adl  sequences  so  that 


•  Co  denotes  the  subspace  of  loo  of  sequences  converging  to  zero. 

•  5  denotes  the  backward  shift  operator  (unit  time  delay). 

•  Pk  denotes  the  A:‘^-truncation  operator  on  loo,e‘ 

-Pfc:  {/o> /ij/z)*  •  — >  {/o5*--,/fe,0, ...} 

•  A  nonlinear  operator  H  loo, e  — >■  ^oo,e  is  causal  if 

PkH  =  PkHPk,  =  0,1,2,..., 

strictly  causal  if 

PkH  =  PkHPk-i,  Vjb  =  0,1,2,..., 

time-invariant  if  it  commutes  with  the  shift  operator  [HS  —  SH),  and  Ip  stable  if 

I  =  sup  sup 

k  fetp,t 

The  quantity  ||Ff  ||  is  cadled  the  induced  operator  norm  over  Ip. 


WPkHfh 

WWt. 


<  oo. 
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•  Ctv  denotes  the  set  of  all  linear  causal  ^oo-stable  operators.  This  space  is  cheirac- 
terized  by  inimite  block  lower  trieoigular  matrices  of  the  form 

(Heo  0  \ 

Hxo  Hxx 

where  Hij  is  a  p  x  g  matrix.  This  infinite  matrix  representation  of  H  acts  on 
elements  of  1%  by  multiplication,  i.e.,  if  u  €  then  y  :=  Hu  6  where 
y{k)  —  Ylj=o  ^kju{j)  €  The  induced  norm  of  such  an  operator  is  given  by: 

=  sup|(ira...irii)li 

t 

where  |.4|i  =  max,-  loiji- 

•  Cti  denotes  the  set  of  all  G  Ctv  which  sire  time-invariant.  It  is  well  known 

that  Cti  is  isomorphic  to  and  the  matrix  representation  of  the  operator  has  a 

Toeplitz  structure.  Every  element  in  Cti  is  associated  with  a  A-transform  defined 
as 

H{\)  =  f;^H{k)XK 

k=0 

The  collection  of  all  such  transforms  is  usually  denoted  by  A,  which  will  be 
equipped  with  the  same  norm  as  the  norm. 

Throughout  this  chapter,  systems  are  thought  of  as  operators.  So  the  composition 
of  two  operators  G,  H  is  denoted  as  GH.  If  both  are  time-invariant  then  GH  G  (i  (or 
Cti),  and  the  induced  norm  is  denoted  by  IIGifjli.  When  the  A-transform  is  referred 
to  specifically,  we  use  the  notation  H  for  the  transform  of  if.  Also,  all  operator  spaces 
are  matrix-valued  ftmctions  whose  dimensions  will  be  suppressed  in  general  whenever 
understood  from  the  context. 

Let  X  be  a  normed  linear  space.  The  space  of  all  bounded  linear  functionals  on 
X  is  denoted  X*,  equipped  with  the  natural  induced  norm;  X*  is  always  complete. 
It  is  convenient  to  put  on  X*  a  weaker  topology  which  makes  X**  =  X.  This  is  the 
weol;*- topology. 

Dual  of  Ip,  1  <  p  <  oo:  The  dual  of  Ip  is  f,,  where  A  -|-  A  =  1.  The  characterization  is 
given  by  the  following  theorem. 
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Theorem  2.2.1  Every  bounded  linear  functional  f  on  Ip,  1  <  p  <  oo,  is  representable 
uniquely  in  the  form 

OO 

»=0 

where  y  =  (y,)  is  an  element  in  fg.  Furthermore,  every  element  of  Iq  defines  a  member 
of  (*  in  this  way  and 

ll/ll  =  IMI, 

The  above  definitions  are  extended  for  vector-valued  sequences  and  matrix-valued  se¬ 
quences  in  the  obvious  way. 

In  this  chapter,  we  will  give  a  solution  to  the  synthesis  problem  by  using  the 
theory  of  Lagrange  multipliers.  Many  people  are  quite  familiar  with  this  theory  for 
finite-dimensional  optimization  problems,  and  in  the  sequel,  we  will  review  the  basic 
duality  theorem  for  infinite-dimensional  problems.  For  a  more  thorough  treatment,  see 
[43]. 

Let  X  be  a  vector  space.  A  convex  cone  P  is  a  convex  set  such  that  if  x  €  P  then 
ax  £  P  for  all  real  o:  >  0.  Given  such  P,  it  is  possible  to  define  an  ordering  relation  on 
X  as  follows:  x  >  y  if  and  only  if  x  —  y  £  P.  Then  it  is  natural  to  define  a  dual  cone  P* 
(with  an  abuse  of  notation)  inside  X*  in  the  following  way: 

P*  =  {*•  G  X*|  <  a:,®*  >>  0  V®  6  P}. 

This  in  turn  defines  an  ordering  relation  on  X*. 

Let  /  be  a  convex  function  from  X  to  IR  and  G  a  convex  map  from  X  to  another 
normed  space  Z.  Also,  let  ft  be  a  convex  subset  of  X.  Assume  that  there  exists  ®i  G  X 
such  that  <j{®i)  <  0  (the  inequality  with  respect  to  some  cone  in  Z).  This  is  generally 
known  as  the  regularity  assumption.  Define  the  minimization  problem: 

Po  =  inf  /(®)  subject  to  ®  G  ft,  (7(®)  <  0. 

The  Lagrange  multiplier  theory  basically  says  that  this  constraint  optimization  problem 
can  be  transformed  to  an  unconstrained  problem  over  ®  G  ft.  Precisely,  there  exists  an 
element  Zq  >  0  in  Z*  (with  respect  to  the  dual  cone),  so  that 

po  =  inf{/(®)-f-  <  G{x),Zo  >} 

ajgu 
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The  element  Zq  is  precisely  the  Lagrange  multiplier.  Equivalently, 

fj,o  =  sup  inf  {/(*)+  <  G{x),2*  >}. 

In  the  case  where  the  inlimization  problem  contains  equality  constrsdnts,  we  wiU  replace 
them  by  two  inequality  constraints.  Care  should  be  taken  in  this  case  since  the  assump¬ 
tion  that  the  constraint  set  has  an  interior  point  will  be  violated;  however  xmder  mild 
assumptions,  if  the  equality  constraints  are  given  in  terms  of  linear  operators,  the  result 
will  stiU  hold  without  the  regularity  conditions. 

2.3  Why  the  £oo  signal  norm? 

In  many  real-world  applications,  output  disturbance  and/or  noise  is  persistent,  i.e.,  con¬ 
tinues  acting  on  the  system  as  long  as  the  system  is  in  operation.  This  implies  that 
such  inputs  have  infinite  energy,  and  thus  one  cannot  model  them  as  “bounded-energy 
sign€ils.”  Nevertheless,  one  can  get  a  good  estimate  on  the  maximum  amplitude  of  such 
inputs.  Examples  where  bounded  disturbances  arise  in  practical  situations  are  abim- 
dant.  Wind  gusts  facing  an  aircraft  in  flight  can  be  viewed  as  bounded  disturbances. 
Without  a  correcting  control  action,  such  disturbances  wiU  cause  the  aircraft  to  deviate 
from  its  set  path.  An  automobUe  driven  over  an  unpaved  road  experiences  disturbances 
due  to  the  irregularity  of  the  course.  Such  disturbances,  although  persistent,  are  clearly 
bounded  in  magnitude.  In  process  control,  level  measurements  of  a  boiUng  liquid  are 
corrupted  by  bounded  disturbances  due  to  the  constant  level  fluctuations  of  the  liquid. 
Because  such  disturbances  are  so  frequent,  a  mathematical  model  describing  them  is 
essential.  The  norm  is  clearly  the  most  natural  choice  for  measuring  the  size  of  such 
disturbances.  In  general,  we  will  assume  that  the  disturbance  is  the  output  of  a  linear 
time-invariant  (LTI)  filter  subjected  to  signals  of  magnitude  less  than  or  equal  to  one, 
i.e., 

d  =  Ww,  ||ty||oo  <  1. 

Not  only  is  the  i^o  norm  useful  for  measuring  input  signal  size,  but  it  can  also  be  very 
useful  as  a  measure  for  the  size  of  output  signals.  For  example,  in  many  applications  it 
is  crucial  that  the  tracking  error  never  exceeds  a  certain  level  at  any  time.  While  this 
requirement  caimot  be  captured  by  using  the  £2  norm,  it  can  be  stated  explicitly  as  a 
condition  on  the  norm  of  the  error  signal.  Another  situation  when  the  norm  is 
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useful  is  when  the  plant,  or  any  other  device  in  the  control  loop,  has  a  maximum  input 
rating  which  should  not  be  exceeded.  This  translates  directly  to  a  requirement  on  the 
foo  norm  of  that  input;  An  example  of  such  a  requirement  appesurs  in  the  next  section; 
In  addition^  the  loo  norm  plays  an  important  role  in  designing  controllers  for  nonlinear 
systems.  Since  most  of  the  nonlinear  controller  designs  are  based  on  linesirization,  the 
linear  model  gives  a  faithful  representation  of  the  system  only  if  the  states  remsun  close 
to  the  equilibrium  point,  a  requirement  captured  directly  in  terms  of  the  too  norm. 

2.4  The  li  Norm 

While  the  norm  is  used  as  a  measure  of  signal  size,  the  li  norm  is  used  to  measure 
a  system’s  amplification  of  loo  input  signals.  Let  T  be  sin  LTI  system  given  by 

t 

z{t)  =  {Tw){t)  =  ^  T{k)w{t  -  k). 

Jfe=0 

The  inputs  and  outputs  of  the  system  are  measured  by  their  maximum  amplitude  over 
all  time,  otherwise  known  as  the  loo  norm,  i.e., 

Iltojloo  =  maxsup 
i  k 

The  li  norm  of  the  system  T  is  precisely  equal  to  the  maximum  amplification  the  system 
exerts  on  bounded  inputs.  This  measure  defined  on  the  system  T  is  known  as  the  induced 
operator  norm  said  is  mathematicsdly  defined  as 

|1T1|=  sup  IITHU  =  imii, 

IH|co<l 

where  ||T||i  is  the  fi-norm  of  the  pulse  response  and  is  given  by 

i  fc 

A  system  is  said  to  be  loo-  stable  if  it  has  a  bounded  li  norm,  and  the  space  of  all 
such  systems  will  be  denoted  by  li.  From  this  definition,  it  is  clear  that  the  system 
attenuates  inputs  if  its  li  norm  is  strictly  less  than  unity. 

In  the  case  where  the  inputs  and  outputs  of  the  linear  system  aire  measured  by  the 
norm,  then  the  gain  of  the  system  is  given  by  the  Hoo  norm  and  is  given  by  [20,  28,  57,  62] 

||t||oo  =  sup  (rmax{f{e'^)). 

O<0<2ir 
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The  two  induced  norms  are  related  by  [4] 

IITIIcc  <  Ciliriii  <  C'3(iNr)||T|U, 

where  C\  is  a  constant  depending  only  on  the  dimension  of  the  matrix  T,  and  Ci  is  a 
linear  function  of  the  McMillan  degree  N  oiT.  In  other  words,  every  system  inside  t\  is 
also  inside  Has-,  but  the  converse  is  not  true.  This  means  that  there  exist  stable  LTI 
systems  that  are  not  stable;  an  exsunple  is  the  function  with  the  A-transform  given 
by  [4]; 

f{X)  =  e-^. 

Thus,  for  LTI  systems,  minimizing  the  f  i  norm  guarantees  that  the  ifeo  norm  is  bounded. 
This  means  that  this  system  will  have  good  ^2-distm:beince  rejection  properties  as  well  as 
^oo-disturbance  rejection  properties.  Also,  the  ti  norm  is  more  closely  edlied  with  BIBO 
stability  notions  and  hence  quite  desirable  to  work  with.  The  disadvantage  in  working 
with  the  norm  is  the  fact  that  it  is  a  Banach  space  of  operators  operating  on  a  Banach 
space,  not  a  Hilbert  space  itself.  Many  of  the  standard  tools  are  not  usable;  however, 
this  chapter  will  present  new  techniques  for  handling  problems  of  this  kind. 

2.5  Prototype  Problems 

In  this  section  we  demonstrate  the  advantages  of  using  the  signjil  norm  by  presenting 
a  few  prototype  problems.  For  each  problem,  certain  control  objectives  related  to  the  loo 
norm  are  to  be  met.  These  problems  demonstrate  the  advantages  of  using  the  too  signed 
norm  as  a  means  of  capturing  time-domain  specifications  in  an  uncertain  environment. 
Later  on,  it  will  be  shown  how  all  such  problems  can  be  treated  in  a  unified  maimer 
under  a  single  framework.  We  shall  then  develop  mathematical  techniques  for  obtaining 
solutions  for  all  problems  which  fit  within  that  framework. 

2.5.1  Disturbance  Rejection  Problem 

Consider  the  system  in  Fig.  2.1.  Here  Po  is  a  plant  and  K  a  controller,  both  LTI. 

The  system  is  subjected  to  bounded  disturbances  which  are  reflected  at  the  plant 
output.  As  mentioned  earlier,  these  disturbances  are  assumed  to  be  the  output  of  a 
time-invariant  filter  Wi  reflecting  the  frequency  content  of  such  disturbances.  The  control 
objective  in  this  case  will  be  to  find  a  controller  K  which  satisfies  the  following: 
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Figure  2.1:  Disturbance  Rejection  Problem 

1.  K  internally  stabilizes  the  feedback  system. 

2.  The  effect  of  the  disturbances  at  the  plant  output  is  minimized,  i.e.,  K  minimizes 

stiP  ll-^IU- 

2.5.2  Command  Following  in  the  Presence  of  Input  Saturation 

The  command  following  problem  is  equivalent  to  the  disturbance  rejection  problem. 
Consider  the  system  in  Fig.  2.2.  The  plant,  P,  suffers  from  saturation  nonlinearities  at  its 


Figure  2.2:  Command  Following  with  Input  Saturation 
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input;  Thereforcj  it  can  be  viewed  as  having  two  components:  a  saturation  componentj 
Sat{.),  and  an  LTI  component,  Pg.  The  sattiration  component  is  defined  as  follows: 


Sat{u) 


U  |u|  <  (/max 
Unutx  1^1  >  Uraax' 


As  a  result  the  plant  is  described  as  P  =  Pg  5a<(*).  Because  of  the  presence  of  the 
saturation,  the  plant  input,  u,  must  not  be  allowed  to  exceed  Umax-  This  requirement 
can  be  captured  in  a  natural  way  using  the  foo  norm  of  u.  In  other  words,  u  must  satisfy 
||«||oo  <  Umax’ 

The  command,  r,  is  to  be  followed  at  the  plant  output.  It  is  not  fixed  but  rather  can 
be  any  command  in  the  set 


{r  =  Ww  :  Halloo  <  1}, 

where  W  reflects  the  frequency  content  of  the  desired  commeinds  and  is  typically  a  low 
pass  filter. 

The  control  objectives  can  now  be  stated  more  precisely.  It  is  desired  to  find  a 
controller  K  so  that: 

1.  K  internally  stabilizes  the  system. 

2.  Ilulloo  <  Umax’ 

3.  y  follows  r  unifornaly  in  time  to  within  a  meiximum  error  level  of  7  >  0,  i.e., 
||y-  riloo  <  7- 

2.5.3  Robust  Disturbance  Rejection 

In  the  previous  two  problems,  the  plant  was  assTuned  to  be  known  exactly.  This  is  rarely 
the  case  due  to  unmodelled  d)Tiamics,  parameter  variations,  etc.  When  the  controller 
designed  for  a  nominal  plant  model  is  implemented  on  the  real  system,  there  are  no 
guarantees  on  the  restdting  performance  of  the  system.  Even  requirements  as  basic  as 
stability  may  not  be  met.  The  deviation  from  the  expected  behavior  of  the  system 
clearly  depends  on  the  accuracy  of  the  model.  Since  modelling  uncertainty  is  inevitable, 
it  is  imperative  to  include  stability  and  performance  robustness  to  model  uncertainty 
as  a  design  objective.  We  now  take  a  second  look  at  the  disturbance  rejection  problem 
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Figure  2.3:  Robust  Disturbance  Rejection  Problem 

discussed  earlier.  Instead  of  considering  a  single  nominal  time-invariant  plant,  P,,,  we 
shall  instead  consider  a  collection  of  plants.  The  class  of  plants  considered  is  taken  to  be 

n  :=  (p  =  P.,  +  W3AW2  :  A  is  causal  and  ||A||  :=  <  l}  , 

I  !!«!!«>  J 

where  W\  and  W2  are  time-invariant  weighting  functions.  In  this  definition,  the  plant 
perturbation.  A,  may  be  time- varying  and/or  nonlinesir.  Any  plant  belonging  to  this 
plant  class  is  said  to  be  admissible.  Note  that  when  A  =  0,  we  recover  the  nominal  LTI 
plant.  Consequently,  the  collection  of  admissible  plants,  11,  may  be  viewed  as  a  ball  of 
plants  centered  aroimd  the  nominal  time-invariant  plant  model.  If  a  system  property, 
such  as  stability,  holds  for  all  admissible  plants  it  is  said  to  be  robust.  We  now  add  to 
our  original  disturbance  rejection  problem  a  new  objective:  robustness.  In  other  words, 
the  controller  K  is  now  required  to  perform  the  following  tasks: 

1.  K  internally  stabilizes  all  admissible  plants,  i.e.,  aU  plants  in  the  class  11. 

2.  K  minimizes  the  effect  of  the  disturbance  w  on  the  magnitude  of  the  output  for 
the  worst  possible  admissible  plant,  i.e.,  K  minimizes  sup  sup  l|y||co* 

2.5.4  Robustness  in  the  Presence  of  Coprime  Factor  Perturbations 

Another  approach  to  the  representation  of  plant  uncertainty  is  through  coprime  factor 
perturbations  [5,  26].  Let  Pg  =  NM~^  be  a  coprime  factorization  of  the  nominal  plant. 
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Figure  2.4:  Coprime  Factor  Perturbations 

The  graph  of  the  plant  Pg  over  the  space  foe  is  define  as  the  image  of  the  space  foo  under 
the  map  Gp^  where 


Gpg  :  igo  ^  i 
Gp,u  = 


oo  ^  ^<X> 

Mu 
Nu  ' 


The  class  of  admissible  plaints  can  be  defined  as  those  plants  whose  graph  is  perturbed 
in  following  way: 


n 


Of 


M  +  Ai' 

L  iv  +  A2  J  ’ ' 


lAill  <  1,  IIA2I 


This  plant  class  can  be  viewed  as  that  obtained  by  perturbing  the  plant  numerator  and 
the  plemt  denominator  independently  as  shown  in  Fig.  2.4.  The  main  objective  in  this 
case  is  to  find  a  controller  K  which  stabilizes  all  plants  in  the  class  11. 


2.5.5  A  Multiobjective  Control  Problem 

In  almost  aU  practical  control  problems,  more  than  one  objective  must  be  met  simulta¬ 
neously.  Perhaps  one  of  the  most  attractive  features  of  the  present  approach  is  its  ability 
to  handle  multiple  objectives  in  a  natural  way.  As  an  example  of  a  multiple  objective 
problem  consider  the  system  in  Fig.  2.5.  In  the  figure  the  plant  is  subjected  to  multi¬ 
plicative  output  perturbations.  In  addition  it  has  a  saturation  nonlinearity  at  its  input  of 
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Figure  2.5:  Mtiltiobjective  Problem 

the  type  discussed  earlier.  A  command  input,  r,  is  applied  while  a  bounded  disturbance, 
d,  is  acting  at  the  plant  output.  The  objectives  in  this  problem  are  a  combination  of 
those  objectives  in  the  first  three  problems  discussed  eeirlier.  Aside  from  stabilizing  all 
admissible  plants,  the  controller  must  also  ensure  that  the  plant  input,  u,  never  exceeds 
its  maximum,  Umaxt  despite  the  presence  of  the  output  disturbance,  the  command  input, 
and  the  plant  uncertainty.  Furthermore,  the  tracking  error  in  this  unfriendly  environ¬ 
ment  must  be  mainteiined  at  a  minimum  level  for  all  time.  These  requirements  on  the 
controller  are  summarized  as  follows: 

1.  K  stabilizes  all  plants  in  11. 

2.  K  is  chosen  so  that  sup  sup  ||u||oo  <  Umax- 

Pen 

3.  AT  is  chosen  so  that  sup  sup  ||e||oo  is  minimized. 

||to.||«><i  Psn 

Comment:  It  is  possible  in  this  formtdation  to  include  time- varying  weights  with  which 
one  can  emphasize  certain  periods  of  the  time  response.  The  general  framework  and 
solutions  presented  in  the  sequel  generalize  in  the  presence  of  such  weights;  however,  we 
wiU  restrict  our  discussion  to  the  time-invariant  case. 
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Figure  2.6:  The  Robust  Performance  Problem 

2.6  A  General  Formulation:  The  Robust  Performance 
Problem 

In  the  previous  section,  we  have  formulated  sample  control  problems  which  reflect  var¬ 
ious  practical  control  requirements.  Two  assumptions  were  embedded  in  the  problem 
statement.  The  first  of  these  is  that  the  command  signsiis  and  the  disturbance  signals 
do  not  necessarily  decay  in  time  but  can  instead  persist  over  aU  time  so  long  as  they 
are  bounded.  This  is  a  fairly  realistic  assumption  and  leads  to  the  adoption  of  the  foo 
norm  to  measure  the  signal  size.  The  second  consists  of  requiring  the  regulated  signals 
of  interest  to  have  small  maximum  amplitudes.  Thus,  once  more,  the  i^o  signal  norm  is 
used  as  a  measTire  for  signal  size,  but  this  time  it  is  the  regulated  output  signals  which 
are  being  measured.  When  considering  that  quite  often  the  output  of  interest  is  a  track¬ 
ing  error,  plant  input  and/or  plant  output,  it  becomes  clear  that  limiting  the  maximum 
value  these  signals  can  achieve  is  desirable  if  not  necessary.  As  a  means  for  obtaining 
a  unifying  framework  for  formulating  and  solving  a  wide  variety  of  problems  with 
signal  norms  and  induced-norm  bounded  perturbations,  we  set  up  the  Robust  Perfor¬ 
mance  Problem.  AU  the  protot3rpe  problems  discussed  in  the  previous  section  are  special 
cases  of  this  general  problem.  So  consider  the  system  in  Fig.  2.6:  A  models  the  system 
uncertainty,  K  is  the  controUer,  and  Go  contains  the  remaining  part  of  the  system.  It  is 
assumed  that  A  belongs  to  the  foUowing  class: 

'E>(n)  :=  {A  =  Ai, . . . ,  A„)  :  A,-  is  causal  and  |j  Ai||  <  1}  . 
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Here  j|Ai||  is  the  induced-^io'-norm;  i;e;;  (|Ai||-=-supu^5  il^|^r-In-  the-sequel;-the-Aj^s 
are  assumed  to  be  SISO  for  simplicity.  There  is  no  time-invariance  restriction  on  the 
perturbations^  and  hence  time- varying  and/or  nonlinesu:  perturbations  are  allowed.  The 
diagonzd  structure  of  the  perturbations  is  essential  for  incorporating  information  about 
the  location  of  the  system  uncertainty.  For  example  actuator  unmodelled  dynamics  are 
not  related  to  sensor  unmodelled  dynamics  or  to  the  plant’s  unmodelled  high-frequency 
dynamics,  and  should  not  be  modeled  by  the  same  perturbation  block.  By  isolating  the 
independent  sources  of  uncertainty,  a  more  realistic  and  less  conservative  system  model 
is  obtained.  This  is  the  main  reason  for  considering  structured  perturbations.  While 
A  models  the  uncertain  part  of  the  system.  Go  is  the  known  part  of  the  system  with 
the  exception  of  the  controller,  and  it  is  a  3  x  3  block  matrix.  The  actual  system  is 
an  element  in  the  upper  linear  fractional  coimection  of  Go  and  the  admissible  A’s.  So 
included  in  Go  is  the  nominal  plant /plants,  any  input  and  output  weighting  functions, 
and  any  weighting  functions  on  the  perturbations.  We  shall  restrict  the  weights  and  the 
nominal  plant  to  be  LTI.  As  a  result,  Go  is  LTI.  The  signal  w  denotes  all  exogenous 
inputs,  including  the  command  inputs  and  the  disturbance  inputs  which  are  assumed  to 
be  in  £oo,  while  z  denotes  the  regulated  outputs.  Both  w  and  z  are  allowed  to  be  vector 
signals.  Prom  now  on,  we  shall  refer  to  the  map  taking  tt;  to  2  as  T^u,.  The  induced  foo 
norm  of  is  defined  as  follows: 


Finally,  the  controller  K  is  assumed  to  be  LTI.  We  are  now  ready  to  state  the  Robust 


Performance  Problem. 


Robust  Performance  Problem;  Find  a  controller  K  so  that 

1.  The  system  achieves  robust  stability,  i.e.,  K  internally  stabilizes  the  system  for  all 
admissible  perturbations,  i.e.,  for  all  A  in  T>[n). 

2.  The  system  achieves  robust  performance,  i.e.,  K  is  chosen  so  that 

sup  ||Tzu,||  <  1. 

A62?(n) 

As  mentioned  earlier,  the  prototype  problems  discussed  can  aU  fit  in  this  framework. 
As  an  example,  for  the  Disturbance  Rejection  Problem  since  the  number  of  perturbation 
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blocks,  n,  is  zero,  has  only  two  inputs  w  and  u,  and  two  outputs  z  £ind  y.  As  a  result 
Go  has  the  form: 


This  is  referred  to  as  the  nominal  performance  problem. 

On  the  other  hand,  for  the  robust  disturbance  rejection  problem  n  will  be  1.  Thus, 
Go  has  an  additional  input  fed  from  the  perturbation  output,  and  an  additional  output 
feeding  the  pertmbation  input.  It  follows  that  Go  has  the  following  structure: 

/  0  0  -W2Po\ 

G,  =  W3  Wi  -Po  . 

\W3  -Po  / 

And  so  on. 

2.7  Robustness  Conditions 

Having  stated  the  Robust  Performance  Problem,  we  can  now  focus  our  attention  on  its 
solution.  In  particular,  we  shall  develop  necessary  and  sufficient  conditions  for  achieving 
both  performance  robustness  and  stability  robustness.  These  conditions  will  be  used  for 
the  robustness  analysis  of  the  system  at  hand.  In  this  case,  the  controller  is  assumed 
given  and  fixed  and  its  effect  on  the  robustness  of  the  system  is  investigated.  The 
same  conditions  developed  for  robustness  analysis  axa  used  to  develop  techniques  for  the 
synthesis  of  robust  controllers. 

We  begin  by  discussing  the  robustness  anedysis  issue.  Suppose  we  are  given  a  nom¬ 
inal  system  Go,  a  perturbation  class  V{n),  and  a  controller  K  coimected  as  shown  in 
Fig.  2.6.  We  can  incorporate  Go  and  K  together  and  view  them  as  one  system,  M,  as 
shown  in  Fig.  2.7.  Thus  M  will  have  two  inputs  and  two  outputs.  We  will  assume  that 
the  controller  K  stabilizes  the  nominal  system  Go’,  otherwise  robust  stability  and  hence 
performance  clesirly  wiU  not  be  achieved.  Consequently,  M  wiU  be  LTI  and  stable.  We 
will  say  the  system  in  Fig.  2.7  achieves  robust  stability  if  it  is  stable  for  all  admissible 
perturbations.  We  wiU  say  that  it  achieves  robust  performance  if,  in  addition,  \\T^w\\  <  1 
for  all  admissible  perturbations.  We  can  now  state  the  following  problem  whose  solution 
is  provided  in  the  next  two  sections: 

Robustness  Analysis  Problem  Under  what  conditions  on  M  will  the  system  in 
Fig.  7  achieve  robust  performance  ? 
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Figiire  2.7:  Robust  Performance  Problem  in  M-A  form 

2.7.1  Stability  Robustness  vs.  Performance  Robustness 

It  is  an  interesting  fact  that  a  robust  performance  problem  can  be  transformed  to  a  robust 
stability  problem.  This  has  been  shown  in  [22,  21,  47]  when  the  perturbations  are  LTI 
with  an  L2  induced-norm.  This  remains  true  in  our  case  as  well,  although  the  method 
of  proof  is  quite  different.  To  elaborate  further  on  this  relationship  between  stability 
robustness  and  performance  robustness  consider  the  two  systems  shown  in  Fig.  2.8. 
System  I  corresponds  to  a  performance  robustness  problem,  while  System  11  is  formed 


System  I  System  II 


Figure  2,8:  Stability  Robustness  vs.  Performance  Robustness 
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from  System  I  by  feeding  z  back  to  u;  through  a  fictitious  peftTirbatipn,  Ap,  satisfying. 

<  1.  As  a  result,  System  11  has  V{n  +  1)  as  its  perturbation  class.  We  can  now 
ask  the  following  question:  How  does  the  performance  robustness  of  System  I  relate  to 
the  stability  robustness  of  System  II  ?  One  aspect  of  the  relationship  between  the  two 
notions  of  stability  is  fairly  obvious:  performance  robustness  of  System  I  implies  stability 
robustness  of  System  II.  This  is  quite  easy  to  see.  Since  robust  performance  is  equivalent 
to  the  norm  of  the  map  between  w  Jind  z  being  less  them  one,  the  Small  Gain  Theorem 
can  be  used  to  establish  the  stability  of  System  II  for  aiU  ||Ap||  <  1,  or  equivalently 
to  establish  the  robust  stability  of  System  11.  Equally  important,  the  relation  between 
stability  robustness  and  performance  robustness  holds  the  other  way  as  well.  In  other 
words,  stability  robustness  of  System  II  implies  performance  robustness  of  System  I. 
This  direction  is  not  as  obvious  as  the  first  one.  The  proof  follows  from  certain  results 
on  the  robustness  of  time- varying  systems. 

2.7.2  Stability  Robustness  Conditions 

Because  performance  robustness  is  equivalent  to  stability  robustness  in  the  sense  dis¬ 
cussed  earlier,  we  need  only  discuss  stability  robustness.  Specifically,  we  can  consider 
the  interconnection  of  a  stable  LTI  system,  M,  with  a  structured  perturbation  A  €  I’(n) 
in  Fig.  2.9,  and  seek  necessary  and  sufficient  conditions  for  the  stability  robustness  of  the 
system.  Since  M  and  A  are  both  stable,  the  internal  stability  of  the  system  is  equivalent 


M 

A 

Figure  2.9:  Stability  robustness  problem 

to  the  map  /  -  MA  having  a  stable  inverse,  one  which  maps  to  itself  with  a  finite 
gain.  When  the  signal  norm  is  the  (2  norm  and  the  perturbations  are  time-invariant, 
the  conditions  are  provided  by  the  Structured  Singular  Value,  the  function  [22].  In 
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particular,  robustness  is  achieved  iff  sup  n{M{e^^))  <  1.  In  our  formulation,  it  turns 

0<«<2)r 

out  that  the  conditions  are  much  simpler  and  easier  to  compute  than  ft.  Before  we  can 
present  these^conditions  we  need  to  define  a  certain  nonnegative  matrix,  M,  which  de¬ 
pends  solely  on  M.  Recalling  M  has  n  inputs  and  n  outputs,  it  can  be  partitioned  as 
follows: 


M  = 


Mil 


Ml 


In 


L  ^nl  •  •  •  J 

Each  Mij  is  LTI  and  stable,  and  thus  Mjj  e  li.  Clearly  ||Mij||i  can  be  computed  with 
arbitrary  accuracy  by  considering  finite  trimcations  of  Mij  as  approximations.  We  can 
now  define  M  as  follows: 

^  'IIMiilii  ...  ||Mi„||i 

M=  :  ; 

.||Mnl||l  ...  ||Mnn||lJ 

One  of  the  most  interesting  aspects  of  the  robustness  problem  formtdated  here  is  the 
role  which  M  plays  in  the  system  robustness.  This  is  presented  in  the  next  theorem  due 
to  Khammsish  and  Pearson  [33,  34,  35]. 

Theorem  2.7.1  The  system  in  Fig.  2.9  possesses  robust  stability  iff  any  one  of  the 
following  holds: 

1.  p{M)  <  1,  where  p(.)  denotes  the  spectral  radius. 

2.  X  <  Mx  and  x  >  0  imply  that  x  =  0,  where  the  vector  inequalities  are  to  be 
interpreted  componentwise. 


3.  inf  ||R“^Mi?||i  <  1,  where  TZ  :=  {diag{Ti, . . .,  r„)  :  rj  >  0}  . 

One  of  the  main  contributions  of  this  theorem  is  that  it  provides  simple  and  ex¬ 
act  conditions  for  testing  the  system’s  stability  robustness  regardless  of  the  number  of 
perturbation  blocks,  n.  While  the  three  conditions  in  the  theorem  are  equivsdent,  each 
provides  a  different  perspective  and  has  certain  advantages  over  the  others.  For  exeimple, 
the  spectral  radius  condition  is  in  general  the  easiest  to  compute.  It  is  particularly  useful 
when  n  is  large  since  it  can  be  computed  efficiently  using  power  methods.  Specifically, 
given  an  M  which  is  assumed  primitive  (i.e.,  M’’  >  0  for  some  integer  k),  then  it  satisfies 
the  following: 


min 


{M'^+^x)i 

{M^x)i 


<  p{M)  <  maoc 


{M’^+'^x)i 

{M>‘x)i 
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for  any  vector  z  >  0.  Furthermore,  the  upper  and  lower  boimds  both  converge  to  p[M) 
as  k  goes  to  infinity.  If  M  were  not  primitive,  it  can  be  perturbed  slightly  to  become 
primitive. 

Whereas  the  spectral  radius  test  provides  a  yes  or  no  answer  concerning  system  ro¬ 
bustness,  the  second  test  involving  the  Linear  Matrix  Inequality  (LMI)  is  most  useful 
for  providing  information  about  the  effect  of  the  individual  entries  of  M  on  the  overall 
robustness  of  the  system.  This  is  achieved  by  translating  the  LMI  condition  into  n  alge¬ 
braic  conditions  stated  explicitly  in  terms  of  the  entries  of  M.  This  is  best  demonstrated 
by  an  example.  Suppose  M  is  a  2  x  2  matrix  corresponding  to  a  certain  robustness 
problem  with  n  =  2.  The  LMI  condition  states  that  robust  stability  iff  the  system 


<  ||.Afn||iZi  -f  ||Mi2||ia:2 
X2  <  ||M2i||iZi  +  ||M22||i®2 


has  no  solution  x  =  (*1,12)  €  [0,  00)  X  [0,  oo)\{0}.  Among  other  things,  this  implies 
that  ||Mii||i  <  1  ;  otherwise  x  =  (1,0)  would  be  a  solution  for  the  two  inequalities.  The 
first  inequality  can  be  rewritten  as 


IIM12I 


-«2- 


When  combined  with  the  second  inequality,  we  have  that 


has  no  solution  in  (0,  00),  which  is  equivalent  to 

This  last  condition,  together  with  the  condition  that  ||Mii||i  <  1,  is  therefore  necessary 
for  the  inequality  robustness  conditions  to  hold.  Be  retracing  our  steps  backwards,  it 
becomes  clear  that  they  are  also  sufficient.  This  procedure  of  constructing  explicit  norm 
conditions  from  the  second  robustness  condition  can  be  repeated  in  the  same  way  for 
any  n. 

Finally,  the  third  robustness  condition  is  useful  for  robust  controller  synthesis.  This 
will  be  discussed  in  more  detail  later  on. 
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Equivalence  of  the  Robustness  Conditions  in  Theorem  2 

Before  we  shed  more  light  on  the  proof  of  Theorem  2,  we  will  show  that  the  three, 
appeirently  unrelated,  conditions  in  the  statement  of  the  theorem  are  indeed  equivalent. 
We  will  show  that  1^2  and  that  1  S.  For  simplicity,  we  will  do  this  for  an 
irreducible  M.  So  suppose  that  p(M)  <  1.  It  follows  that  (I  —  M)~^  exists.  Since 
(I  -  M)~^  =  I  +  M  +  +  . . . ,  all  of  its  entries  will  be  positive.  Now  if  a;  >  0  is  such 

that  X  <  Mx,  or  equivalently,  (J  -  M)x  <  0,  then  multiplying  both  sides  by  (/  -  M)~^ 
implies  that  x  <  0.  Thus  x  must  be  zero.  This  is  what  2  states.  To  show  that  2 
implies  1,  suppose  1  does  not  hold,  i.e.,  that  p{M)  >  1.  The  Perron-Erobenius  theory  for 
nonnegative  matrices  states  that  p{M)  is  itself  an  eigenvalue  of  M.  Moreover,  associated 
with  p{M)  yre  can  find  an  eigenvector  x'  >  0.  This  implies  that  p{M)x'  =  Mx',  which 
in  turns  implies  that  2  does  not  hold.  Thus,  we  have  demonstrated  that  1^2, 

We  now  show  f  5  by  showing  that  p{M)  =  infngTe  ||JZ~^MiZ||i.  By  definition. 

The  expression  on  the  right  is  also  equal  to  the  induced  norm  of  the  matrix  R~^MR 
as  a  map  from  (IR”,  ||.||oo)  to  itself.  Referring  to  this  norm  by  j.ji,  we  therefore  have 
=  \R~^MR\\.  Since  any  matrix  norm  bounds  from  above  the  spectral  radius 
of  that  matrix  we  have: 

inf  =  inf  \R-^MR\x  >  p{R-^MR)  =  p{M). 

But  if  we  choose  R  =  diag{ri, . . . ,  r’^),  where  (rj , . . . ,  is  the  positive  eigenvector  cor¬ 
responding  to  the  eigenvalue  p{M),  the  inequality  becomes  an  equality  and  the  equiv¬ 
alence  between  1  and  3  is  established.  It  is  interesting  to  note  that  for  the  optimum 
scalings  R  =  diag{r[, . . . ,  rj,),  aU  the  rows  of  R~^MR  have  the  same  norm.  As  will  be 
demonstrated  shortly,  this  fact  is  used  to  show  why  condition  3  in  the  above  theorem  is 
necessary  for  system  robustness. 

Proof  of  Necessity  and  Sufficiency 

When  n  =  1,  the  spectral  radius  condition  in  the  theorem  above  reduces  to  the  condition 
||M||i  <  1.  A  simple  application  of  the  Small  Gain  Theorem  shows  that  this  condition 
is  sufficient  for  stability.  Necessity  has  been  shown  by  Dahleh  and  Ohta  [9].  For  n  larger 


22 


Figure  2.10:  Scaled  System 

than  one,  we  now  show  that  inf;jg7e  <  1  is  sufficient  for  robust  stability. 

We  do  this  with  the  aid  of  Fig.  2.10  obtained  via  the  addition  of  scalings  R  and  iZ~^, 
where  R  £  TZ.  Clearly,  the  robustness  of  this  system  and  that  in  Fig.  9  are  equivalent 
in  the  sense  that  if  one  is  robustly  stable,  then  so  is  the  other  one.  Moreover,  for 
the  system  in  Fig.  2.10,  RAR~^  belongs  to  I?(n)  whenever  A  belongs  to  V{n),  and  thus 
IliZAiZ-  i||  <  1.  That  being  the  case,  the  Small  Gain  Theorem  can  be  invoked  to  conclude 
that  ||i?“^MiZ||i  <  1  is  sufficient  for  robust  stability.  This  holds  for  any  R  £  TZ.  The 
least  conservative  sufficient  condition  obtainable  in  that  manner  is 

jn^||5-iMi?||i<l. 

We  now  demonstrate  that  infjRgTj  ||iZ“^Mi2||i  <  1  is  necessary  for  robust  stability. 
For  simplicity,  we  do  this  for  the  case  n  =  2.  The  approach  will  be  to  show  how  one 
can  construct  a  destabilizing  perturbation  A  €  V{2)  whenever  inf/jgTj  >  1. 

So  suppose  that  infflgTi  ||jR~^M.R||i  >  1.  We  have  previously  shown  that  this  infimum 
is  in  fact  a  minimum,  and  it  is  achieved  by  an  optimum  scaling,  R,  obtained  from  the 
eigenvector  corresponding  to  p{M).  It  was  also  shown  that  the  two  rows  of  R~^MR  will 
have  equal  norms.  This  can  be  expressed  as  follows: 

=  ||(i?-iMi2)2||i  =  \\R-^MR\U  >  1. 

where  {R~^MR)i  denotes  the  ith  row  of  R~^MR.  The  system  R~^MR  appears  in 
Fig.  2.11  and  has  as  its  input  ^  and  output  z  =  {zi,Z2).  In  the  figure, 

y  =  {yiiy2)  consists  of  the  output  z  —  (21,22)  after  a  boimded  signal,  the  output  of 
a  sign  function,  has  been  added  to  it.  This  bounded  signal  will  be  interpreted  as  an 
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Figure  2.11:  Scaled  System  with  Constructed  Input  ^ 


external  signal  injected  for  stability  analysis.  The  strategy  taken  will  be  to  construct  ( 
satisfying  the  two  requirements: 

1.  ^  is  unbounded. 

2.  4  results  in  a  signal  y  which  satisfies  |lPfc^i||i  <  ||Pfej/t||i  for  i  =  1,2,  where  Pfe  is 
the  truncation  operator  which  acts  on  sequences  by  preserving  the  first  k  +  1  terms 
and  setting  the  rest  to  zero. 

The  first  requirement  on  ^  guarantees  that  if  an  admissible  perturbation  A  were  to 
map  y  to  it  would  be  a  destabilizing  one  because  the  bounded  external  signal  would 
have  produced  an  unbounded  internal  signal  The  second  requirement,  guarantees 
that  such  an  admissible  perturbation  exists.  In  other  words,  if  ^  and  y  satisfy  the  second 
condition,  then  it  is  possible  to  find  A*,  for  z  =  1,2,  so  that  A*  is  causal,  has  induced 
norm  less  than  or  equal  to  one,  and  satisfies  A^i/i  =  I,-.  If  the  first  requirement  is  also 
met,  this  A  will  be  a  destabilizing  perturbation. 

For  simplicity  we  shadl  assume  that  aU  Mij's  have  finite  impulse  response  of  length, 
say  N.  The  construction  of  ^  proceeds  as  follows.  While  maintaining  <  1 

for  ife  =  0, . . . ,  iV  -  1,  the  first  N  components  of  ^  can  be  constructed  so  as  to  achieve 
||(P"^MP)i||i.  Since  ||(P~^MJ2)i||i  >  1,  this  implies  that  ||Piv_izj|c»  >  1,  which  in 
turn  implies  that  ||Piv-iy||oo  >  2.  Next,  while  still  maintaining  |£t(fc)|  <  1,  we  pick  the 
next  N  components  of  ^  so  as  to  achieve  the  second  row  norm,  |l(P~^MP)2i|i.  As  a 
result  we  have  ||P2iV-i-2t|ioo  >  1  which  implies  that  ||P2iV-it/tj|oo  >  2.  Note  that  the 
second  requirement  on  ^  has  been  met  for  4  =  0,...,  2N  —  1.  In  addition,  because  of  the 
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way  the  first  2N  terms  of  ^  have  been  constructed,  we  have 


>  il-PsiV-l^xIloo  +  1  t  =  1,2. 

This  allows  us  to  relax  the  restriction  on  |^i(^)|  for  k  >  2N  —  1  without  violating  the 
second  requirement  on  Specifically,  we  now  allow  ||t(^)i  to  be  as  large  as  2  for 
k  =  2N, . 4N  -  1.  In  the  same  way  as  before  we  can  pick  ^{k)  for  this  range  of  k  so 
that  we  satisfy 

||T’4iV-iyi||oo  >  ||■P4i^r-l^iiioo  +  1  t  =  1,2. 

which  allows  us  to  increase  |^,(fc)|  by  1  for  the  next  2N  components  of  and  repeat 
the  whole  procedme  again.  From  this  construction,  it  is  clear  that  when  ^  is  completely 
specified  it  will  be  unbounded  and  hence  meets  the  first  requirement.  The  second  re¬ 
quirement  is  also  met  since  €dl  along  was  chosen  carefully  so  as  not  to  become  too 
large  too  soon. 

It  should  be  mentioned  that  the  destabilizing  perturbation  can  be  taken  to  be  linear 
time- varying  (LTV),  or  it  can  instead  be  nonlinear  time-invariant.  So  the  spectral  radius 
condition  for  robustness  is  also  necessary  and  sufficient  whenever  the  class  of  perturbation 
is  restricted  to  include  norm-bounded  nonlinear  time-invariant  perturbations. 

Construction  of  the  Destabilizing  Perturbation 

In  the  previous  section,  we  have  claimed  that  given  ^  ^  ^oo,e  y  = 

{!/(0}iSo  6  ^oo,e  so  that  liPfe^illoo  <  llPfe-iytilooVA:,  and  for  i  =  1,2,  then  there  exists 
A  =  diag{Ai,  A2)  such  that  Ay  =  ^  and  ||Ai||  <  1.  Such  a  A  was  shown  to  be  a 
destabilizing  perturbation.  In  this  section,  we  prove  this  cldm  by  explicitly  constructing 
the  perturbation  A.  It  turns  out  that  A,-  can  be  either  LTV  or  nonlinear  and  time- 
invariant.  We  shall  construct  Ai  to  be  of  the  former  type,  while  A2  will  be  of  the  latter 
type. 

So  suppose  we  are  given  ^  ^00, e  and  yi  =  {t/i(t)}go  ^  ^00, e  such 

that  ||Pfc^i||co  <  llPfeyillooVfe.  The  construction  of  Ai  is  trivial  if  t/i  =  0:  just  pick  Ai 
itself  to  be  zero.  So  assume  yi  ^  0.  We  start  the  construction  of  Ai  by  identifying  a 
subsequence  of  yi,  say  {yi{ii),yi{i2)^  •  •  •  )  which,  depending  on  j/i,  may  or  may  not  be 
finite.  This  subsequence  may  be  defined  recursively  in  the  following  manner:  Let  ii  be 
the  smallest  integer  such  that  yi(*i)  ^  0.  Given  yi(zn),  let  be  the  smallest  integer 
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greater  that  such  that  |yi(tn+i)|  >  bi(in)|-  Using  the  ^i(t)’s  and  Pi(tj)’3  we  are  now 
ready  to  construct  Ai  through  specifying  its  matrix  kernel  representation  as  follows: 


Ai  = 


Mill 

yi(u) 

i  0 


VI  (»l ) 


0 


0 


\ 


fi(»a 
Vl(*3 

:  0 


■IfeU. 

Vl (»3 ) 


0 


0 

Mill 

yi(n) 


J 


Notice  that  each  row  of  the  above  matrix  has  at  most  one  nonzero  element,  which,  by  the 
choice  of  the  s/i(tj)’s,  will  have  its  absolute  value  less  than  or  equal  to  one.  This  implies 
||Ai||  <  1.  Moreover,  Aj  is  clearly  causal  and  it  can  easily  be  checked  that  Aiyi  = 
which  is  what  we  wanted  to  show. 

We  now  construct  a  nonlinear,  time- invariant,  emd  causal  perturbation  Aj.  As  before, 
A2  must  be  so  that  IIA2II  <  1  and  A2J/2  =  ^2-  Let  A2  be  defined  as  follows: 


if  for  some  integer  i  >  0,  Pkf  =  PkSi^2 
otherwise. 


Note  that  A2  maps  j/2  to  ^2  and  i|A2|l  <  1. 


2.7.3  Comparisons 

It  is  worthwhile  comparing  the  class  of  perturbations  that  have  gain  less  than  unity  over 
£2  (which  arise  in  the  standard  //)  with  the  class  of  perturbations  that  have  gain  less  than 
unity  over  ^00 •  If  the  perturbations  are  restricted  to  time-invariant  ones,  the  ^00-stable 
perturbations  with  gain  less  than  unity  lie  inside  the  unit  ball  of  ^2-stable  perturbations 
(for  the  multivariable  case,  the  unit  ball  wiU  be  scaled  by  a  constant).  Tliis  follows 
directly  from  the  norm  inequality  between  ii  and  Ifoo-  If  the  perturbations  are  allowed 
to  be  time-varying,  then  the  two  sets  are  not  comparable.  Earlier,  an  example  was 
presented  that  shows  that  the  Hoo  ball  is  larger  than  the  £i  ball.  On  the  other  hand,  the 
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Perturbation  class 

p.{M)  <  1 

ISBBi 

NLTV,  bounded  f2-gain 

nec 

suff 

suff 

NLTV,  bounded  fco-gain 

nec 

nec 

nec  and  suff 

NLTI,  bounded  f2-gain 

nec 

suff 

suff 

NLTI,  bounded  ^oo-gain 

nec 

nec 

nec  and  suff 

LTV,  bounded  f2-iaduced  norm 

nec 

suff 

suff 

LTV,  bounded  foo -induced  norm 

nec 

nec 

nec  and  suff 

LTI,  bounded  f2-induced  norm 

nec  and  suff 

suff 

suff 

LTI,  bounded  loo  induced  norm 

nec  and  suff 

suff 

suff 

Table  2.1:  Comparisons  between  different  robustness  criteria 


operator  A  defined  by 

(A/)(fc)  =  /(O) 


is  loo  stable  but  not  l^  stable. 

A  question  which  might  arise  is,  how  do  the  derived  robustness  conditions  differ  from 
the  Structured  Singular  Value?  The  answer  lies  in  the  class  of  perturbations  assumed. 
While  the  pertmrbations  here  may  be  nonlinear  time- varying  (NLTV),  nonlinear  time- 
invariant  (NLTI),  or  LTV  for  the  conditions  to  be  necesssiry  and  sufficient,  ^  theory  gives 
necessary  and  sufficient  conditions  only  for  LTI  perturbations.  In  terms  of  computation, 
the  robustness  test  proposed  here  is  much  easier  to  compute  and  gives  exact  answers 
for  any  number  of  perturbation  blocks,  n.  On  the  other  hand,  ^  is  much  harder  to 
compute  especially  since  for  n  >  3  only  an  upper  bound  can  be  computed.  One  can  use 
the  small  gain  theorem  to  get  sufficient  conditions  for  robust  stability  in  the  presence  of 
NLTV  P  induced  norm-bounded  perturbations  in  the  same  way  it  was  done  for  the  A 
norm.  In  this  case,  a  sufficient  condition  would  be  inf/jg7j  <  1.  It  is  not 

known  whether  this  condition  is  edso  necessary.  However,  it  is  not  sufficient  to  guarantee 
robustness  when  pertrirbations  of  the  type  considered  in  this  chapter  Jire  present,  i.e., 
for  loo  induced  norm-botmded  perturbations.  In  contrast,  robustness  in  the  presence 
of  loo  induced-norm  boimded  perturbations  does  imply  robustness  to  induced-norm 
bounded  perturbations.  The  relationship  between  the  various  robustness  conditions  is 
summarized  in  Table  1  (In  the  table:  nec,  suff  respectively  mean  necessary  and  sufficient). 

In  terms  of  robust  controller  synthesis,  the  controller  must  be  chosen  so  that  p{M) 
is  minimized.  The  dependence  of  M  on  the  controller  is  reflected  through  the  Youla 
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parameter,  Q,  since  M  cam  be  expressed  as  [28,  57,  61] 

M  =  M(g)  =  Ti  -  T2(?T3, 

where  the  Ti's  depend  only  on  Go-  Because  p{M)  =  infRgTt  ||jR“^Mi?||i,  the  robustness 
synthesis  problem  becomes  one  of  finding 

Q  stable -"cTi 

With  Q  stable  and  fixed,  we  have  seen  that  picking  the  eigenvector  associated  with 
p{M{Q))  will  yield  the  minimum  value  over  all  scalings  in  TZ.  When  R  is  fixed,  we  have 
an  fi-norm  minimization  problem.  This  problem  and  its  solution  will  be  discussed  in 
the  remaining  part  of  the  chapter.  So  the  approach  which  will  be  taken  to  solving  the 
robustness  synthesis  problem  is  to  start  with  an  initial  R  S  TZ-  For  that  R  we  find 
the  optimal  Q  resulting  from  the  norm  minimization  problem.  We  then  fix  that  Q  and 
solve  for  the  optimal  R  associated  with  this  new  Q  and  so  on.  Since  at  each  step  the 
objective  function  gets  smaller  and  smaller,  and  since  it  is  bounded  from  below  by  zero 
it  is  guaranteed  to  converge  to  some  value.  Unfortunately,  this  value  may  not  be  the 
global  minimTim.  If  at  that  point,  a  satisfactory  level  of  performance  robustness  has 
been  reached,  we  can  stop  and  use  the  final  Q  to  construct  the  controller.  Otherwise, 
the  iteration  process  should  be  restarted  with  a  different  initial  scaling  matrix  in  7Z. 
This  scheme  is  similar  to  the  so-called  D  -  K  iteration  used  in  the  /i-synthesis  technique 
[22,  21].  The  main  difference  is  that  while  the  scales  used  for  /x-synthesis  are  frequency 
dependent  and  a  convex  optimization  problem  must  be  solved  at  each  frequency,  the 
scalings  here  are  not  frequency  dependent  and  can  be  readily  found  by  computing  the 
eigenvector  associated  with  p{M).  Such  a  computation  can  be  done  very  effectively  using 
power  methods,  and  no  optimization  problem  need  be  solved  to  find  the  optimal  scalings. 

2.8  Synthesis  of  the  £i  controller 

As  stated  earlier,  the  ii  minimization  problem  is  given  by: 

Mo=  ird  IIT1-T2QT3II1  (OFT) 

Q  stable 

In  this  section,  we  will  show  that  this  problem  is  equivalent  to  a  linear  programming  prob¬ 
lem  in  an  infinite-dimensional  space.  By  utilizing  the  duality  theory  of  Lagrange  multi¬ 
pliers,  it  is  shown  that  in  some  cases  the  linear  programs  are  in  fact  finite- dimensional 
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and  thus  exact  solutions  for  (OPT)  can  be  obtained.  For  the  rest  of  the  cases^  the  duality 
theory  provides  upper  and  lower  approximations  of  the  optimal  solution.  The  use  of  the 
Lagrange  multiplier  theory  highlights  the  strong  resemblance  between  the  lx  problem 
and  standard  linear  programming  problems. 

The  admissible  subspace  S  is  defined  as: 

S  =  {Re  =  TjQTa,  Q  is  stable} 

The  f  1  problem  can  be  interpreted  as  a  distance  problem:  Find  an  element  in  the  subspace 
S  which  is  closest  to  the  fixed  element  Ti,  where  distance  is  measured  in  the  fi-norm^ 
Previous  work  [10, 11]  used  the  duality  theory  for  distance  problems  to  arrive  at  a  solution 
for  (OPT).  Here  we  take  an  alternate  approach  using  Lagrange  multiplier  theory,  which 
is  in  fact  more  intuitive  and  transparent,  to  arrive  at  similar  conclusions. 


2.8.1  Characterization  of  the  Subspace  S 


In  the  discussion  below,  it  is  assumed  that  T2  has  fuU  column  rank  =n2,  and  T3  has 
full  row  rank  =n3.  It  is  evident  that  this  captures  the  most  general  situation  since  if 
either  of  these  conditions  does  not  hold,  we  can  perform  inner-outer  factorizations  on 
T2  and  23  and  absorb  the  extra  degree  of  freedom  in  Q.  Also,  it  is  assumed  that  there 
exist  n2  rows  of  T2  and  columns  of  T3  which  are  linearly  independent  for  all  A  on  the 
unit  circle.  This  assumption  simplifies  the  exposition  although  it  is  not  necessary.  In 
general,  it  is  enough  to  assume  the  above  for  1  point  on  the  unit  circle  [55].  Under  this 
assumption,  T2  and  T3  can  be  written  in  the  following  form  without  loss  of  generality 
(possibly  requiring  the  interchange  of  inputs  and/or  outputs): 


r3  =  (T’3i  132) 


where  T21  has  dimensions  n2  X  n2  and  is  invertible  and  T31  has  dimensions  ns  x  and 
is  invertible.  Moreover,  T21  and  Tax  have  no  transmission  zeros  on  the  unit  circle.  Thus 
R  =  f2QT3  can  be  written: 


R  = 


l“) 


The  objective  is  to  obtain  a  characterization  of  the  feasible  set  S.  Notice  that  Q  can  be 
uniquely  determined  from  the  equality  .Hu  =  T^iQTsi-  As  was  shown  in  [10,  44],  the 
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choice  of  Rn  is  constrained  by  the  zeros  of  221)  ^3i  that  are  inside  the  unit  disc.  There 
is  only  a  finite  number  of  such  zeros,  and  each  zero  is  interpreted  as  a  bounded  linear 
functional  on  iZu.  In  the  sequel,  we  use  the  following  terminology: 

Definition  2.8.1  A  transfer  function  G  interpolates  T2i,  Isi  ifT^^GT^^  is  stable. 

The  motivation  for  this  terminology  stems  from  the  fact  that  for  ^2-1^  Gf^i  to  be 
stable,  G  must  have  zeros  at  the  same  locations  and  directions  as  the  zeros  of  T’2i  and 
Tsi-  Each  zero  is  in  fact  a  bounded  linear  ftmctional  that  annihilates  the  element  G,  and 
thus  has  a  representation  inside  the  dual  space  of  ft)  with  the  appropriate  dimension. 
If  these  functionals  are  inside  co  then  we  can  view  G  as  the  annihilator  in  the  dual  of 
Co.  For  example,  let  G{a)  =  0,  where  G  is  SISO,  and  |a|  <  1.  By  definition  of  (?,  we 
have  (j(a)  =  =  0-  Define  Za  =  (l,a^,a^, ...)  €  Co,  then  the  interpolation 

condition  can  be  expressed  as  <  Za,<?  >=  0.  If  a  is  a  complex  number,  then  two 
functionals  are  defined,  the  real  of  Za  and  the  imaginary  of  Za-  The  multivariable  case 
carries  more  details,  but  the  basic  idea  is  the  same  (see  [10,  44]). 

The  choice  of  jRn  is  constrained  further  so  that  the  rest  of  the  equations  are  stiU 
consistent,  which  in  turn  dictates  a  set  of  constraints  on  the  rest  of  the  elements  of  R. 
Define  the  following  coprime  polynomial  factorizations: 


=  b,  N, 

f3'l'#32  =  ABJ'. 

Using  these  definitions,  we  state  the  following  result  characterizing  the  feasible  set  5  for 
this  case  [44]. 

Theorem  2.8.1  Given  T2i't'z  with  the  assumptions  as  above,  and  R  £  A,  there  exists 
Q  £  A  satisfying  R  —  f2Qfz  if  a.nd  only  if: 


i). 

ii). 


(  -Rll  Ri2  ) 


-Nz 

Dz 


Hi).  Rii  interpolates  T21  and  Tzi 

The  conditions  shown  in  parts  i,  ii  are  convolution  constraints  on  the  f  1  sequence  R.  The 
interpolation  condition  in  the  last  part  can  be  tightened,  since  only  the  common  zeros 
of  T’21  and  T22  need  to  be  interpolated. 
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The  discussion  above  shows  that  the  characterization  of  S  can  be  summarized  by 
defining  two  operators, 

V  ;  _  nt* 

and 


C  :  £{ 


where  s,  r  are  some  integers.  The  first  operator  captures  the  interpolation  constraints, 
and  thus  has  a  finite  dimensional  ramge,  and  the  second  captures  the  convolution  con¬ 
straints.  These  two  operators  cam  be  constructed  in  a  straightforward  fashion,  book¬ 
keeping  being  the  only  difficulty.  To  overcome  this  problem,  it  is  helpful  to  think  of  R 
as  a  vector  rather  than  a  matrix.  To  illustrate  this,  let  the  operator  W  be  a  map  from 
to  fj""  defined  as  follows: 


{WR){k)  = 


r2i{k) 


\r«n(A:)/ 


The  operator  W  is  a  one-to-one  and  onto  operator,  whose  inverse  is  equal  to  its  adjoint  (a 
fact  used  later).  It  simply  re-auranges  the  variables  in  R.  The  conditions  on  R  presented 
in  the  above  theorem  cam  be  written  explicitly  in  terms  of  each  component  of  R. 

To  construct  the  first  operator  V,  recaiU  that  each  interpolation  condition  is  inter¬ 
preted  as  a  bounded  linear  functioned  on  R.  By  stacking  up  these  functionals,  the  opertor 
V  is  constructed.  For  example,  suppose  T21  aind  t^i  aure  SISO  aind  both  have  N  zeros  a,- 
in  the  open  unit  disc.  Then  the  matrix  V  is  given  by  V  =  FooW  where 

/  iZe(o?)  0  0  0  Re{al)  0  ...  iZe(o()  0  ...\ 

/m(a°)  0  0  0  Im{a\)  0  ...  lTn{a{)  0  ... 

Voo=  :  :  i  i  !  :  :  ;  i  i  j  =  0,1,2,... 

iEe(a^)  0  0  0  .ffe(ajy)  0  ...  Re{aj^)  0  ... 

y/m(o^)  0  0  0  Im{a]^)  0  ...  0  .../ 

For  the  second  operator,  C,  recall  that  convolution  can  be  interpreted  as  multiplication  by 
a  block  Toeplitz  matrix,  in  this  case  with  finite  memory  since  Nz,  Dti  Nz  and  Dz  all  have 
finite  length  (the  corresponding  A-transform  is  a  polynomial).  By  simple  rearrangement, 
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the  operator  is  constructed  with  its  image  inside  l\.  Hence  C  is  given  by  C  =  TW,  where 
T  is  a  block  lower  triangulair  matrix.  For  a  detailed  example,  see  [11,  44]. 

To  illustrate  the  construction  of  the  operator  T,  consider  as  an  example  the  coprime- 
factor  perturbation  problem  considered  earlier  for  a  SISO.  The  condition  for  stability 
robustness  is  given  by  [5] 


||[F-QiV  -  CT -f  Qm]  111  <  1. 


In  this  case,  T2  =  1  and  T3  =  {N  -  M).  Since  M~^N  =  NM  ^  with  N,  M  coprime, 
the  conditions  in  the  above  theorem  translate  to 


{Rn  R12)  =  0 


The  matrix  T  is  then  given  by; 


r  = 


/(m(0)  n(0))  0 

(m(l)  n(l))  (m(0)  n(0)) 

(m(2)  n(2))  (m(l)  n(l)) 

(m(3)  n(3))  (m(2)  n(2)) 


0 

0 

(m(0)  n(0)) 
(m(l)  n(l)) 


0  0 

0  0 

0  0 

(m(0)  u(0))  0 


...X 


•;  / 


It  is  interesting  to  note  that  in  this  example  the  operator  C  captures  aU  the  conditions 
and  no  interpolation  conditions  are  needed.  The  conditions  presented  in  the  theorem 
can  be  redundant,  and  can  be  significantly  reduced  [55]. 

The  subspace  S  is  then  the  set  of  aU  elements  R  €  so  that  VR  =  0  and  CR  =  0. 
Let  bi  =  VTi,  62  =  CTi,  and  $  =  Ti  —  iE.  The  optimization  problem  can  be  restated 
as: 


subject  to  V#  =  61,  C#  =  62 


{OPT). 


2.8.2  Relations  to  Linear  Programming 

It  is  well-known  that  in  finite-dimensional  spaces  fi-norm  minimization  is  equivalent  to 
linear  programming.  This  turns  out  to  be  true  in  general,  and  can  be  justified  as  follows: 
Let  $  =  with  <l>ij{k),  ^jj{k)  >  0.  The  norm  is  then  replaced  by  the  function 

“laxt  Yl3,k  HjW  +  Define  the  operator  AJ' :  ->•  R"*  by  =  J2j,k 


32 


The  following  problem  is  easily  seen  to  be  equivsilent  to  (OPT): 

inf  ft 

subject  to 

—  fie  <0 
V(#i  _  $2)  =  bi 
C(f  1  -  $2)  =  62 
>  0 

where  e  G  IR"*  and  =  (1,1,...,  1).  It  is  interesting  to  notice  that  if  $^,$2  were 
restricted  to  finite  impulse  response  sequences,  the  above  problem  is  readily  a  linear 
programming  problem.  This  will  turn  out  to  be  a  crucial  observation  in  obtaining  ap¬ 
proximate  solutions,  as  will  be  described  later  on. 


2.8.3  Lagrange  Multiplier  Formulation 


Let  X  =  X  X  ffi.  and  ^  =  K."*  X  IR*  X  ]R*  X  X  tl.  Let  P^,  Pz  denote  the 
positive  cones  inside  X,  Z  consisting  of  elements  with  noimegative  pointwise  components. 
Define  the  operator  A:  X  Z,  decomposed  conformally  with  X  and  Z,  and  the  vector 
b  £  Z  as  follows: 


A  = 


(U 

M 

-e\ 

(  °  ^ 

V 

-V 

0 

bi 

-V 

V 

0 

&  = 

-bx 

c 

-c 

0 

h 

{-C 

c 

0 ; 

\-hj 

Define  the  linear  functional  c*  = 


on  X.  With  these  definitions,  (OPT)  becomes: 


inf  <  x,c*  > 

subject  to 

Ax  <  b 
X  £  X,x  >  0, 

where  x  £  X  has  the  form 
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All  the  inequalities  should  be  interpreted  with  respect  to  the  positive  cones.  It  is  in¬ 
teresting  that  with  the  above  definitions,  (OPT)  looks  very  much  like  a  standard  linear 
programming  problem,  with  the  exception  that  the  number  of  variables  and  constraints 
is  infinite. 

The  Lagrange  multiplier  is  an  element  inside  Z* ,  the  dual  space  of  Z  which  can  be 
identified  as:  Z*  =  IR"*  x  IR*  x  IR*  x  eg  x  Cq.  (Here  we  have  assumed  that  Z  is  equipped 
with  the  weak*  topology,  not  the  norm  topology.)  The  dueil  cone  again  consists  of 
the  noimegative  elements  in  Z*.  The  Lagrangian  can  be  defined  as 

£(*,  z*)  =  {<  a:,c*  >  -I-  <  Ax  -  b,  z*  >} 

=  {<x,c*  +  A^z*>-<b,z*>} 

where  A*  :  Z*  -*  X*  is  the  adjoint  operator  of  A.  From  the  theory  of  Lagrange 
mtdtipliers  [43],  the  minimum  solution  csin  be  obtained  by  performing  sin  unconstrained 
minimization  of  L,  i.e., 

/io  =  sup  inf{<  x,c*  -f-  A*z*  >  -  <  b,z*  >} 

Clearly  for  fiQ  to  be  finite,  i.e  fio  >  —oo,c*+A*z*  >0  and  hence  the  above  infimization 
is  achieved  for  a;  =  0.  This  gives  a  dual  formulation  of  (OPT)  summarized  as: 

fio  =  sup  <  b,  —z*  >  subject  to  c*  -f-  A*z*  >  0  (DOPT). 

z*>0 

To  evaluate  this  explicitly,  let  A*,  z*  be  given  by: 

/AT*  V*  -V*  C*  -C*\ 

A*^\M*  -V*  V*  -C*  C* 

V-e^  0  0  0  0  / 

By  direct  substitution,  (DOPT)  is  converted  to 

flQ  —  sup  <  6i,  ai  -  02  >  +  <  &2)  01-  ^2  > 

subject  to 

M*r)  +  V*(ai  -  02)  +  C*(/3i  -  02)  >Q 

-  V(ai  -  02)  -  C’(/3i  -  02)  >  0 
m 

<  1 

t=i 

oci,a2,0u02,V>  0. 


z  = 


^  v\ 

Otl 

02 

01 

\02j 
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Finally,  substituting  a  =  ai  —  aj  and  ^  =  /3i  —  /Sj  we  get 


Ho  =  sup  <  6i,  a  >  +  <  62,^3  > 

subject  to 

-  Ar*T]  <  Va  +  C*f3  <  U*-n 

m 

1=1 

a  6  ]R%  /3  €  cl. 


{DOPT) 


This  dual  formulation  sheds  a  new  light  on  the  optimization  problem.  In  our  context, 
it  will  provide  two  importjmt  results:  the  existence  of  finite- dimensional  duals  for  specific 
classes  of  problems,  and  the  ability  to  construct  suboptimal  solutions  that  are  within  a 
prescribed  e  from  the  actual  minimum. 

Comment:  The  computation  of  the  adjoint  operators  is  quite  simple  once  the  operators 
are  already  constructed.  Recall  that  V  =  FooW;  hence  the  adjoint  operator  V*  = 
Similarly,  C*  —  Matrix  representations  of  the  operator  A/"  and  its 

adjoint  are  obtained  in  a  similar  fashion. 


2.8.4  Exact  Solutions  for  a  Class  of  Problems 

Let  the  space  S  be  characterized  solely  by  interpolation  conditions.  This  is  the  situation 
when  both  T2  and  T3  have  full  row  rank  and  column  rank  respectively.  In  this  case  C  =  0 
and  62  =  0.  The  dual  problem  (DOPT)  involves  only  a  finite  number  of  variables  and 
thus  it  is  a  finite-dimensional  problem.  The  constraints  however  are  infinite.  Since  the 
elements  of  V*  were  constructed  from  zeros  inside  the  unit  disc,  the  entries  wiU  eventually 
decay  and  only  a  finite  number  of  the  constraints  are  active.  A  botmd  on  the  number  of 
such  constraints  can  be  derived  [10].  The  problem  is  now  a  standard  finite-dimensional 
linear  program,  which  can  be  solved  exactly.  The  solution  to  the  primal  problem  (OPT) 
can  be  constructed  either  by  the  alignment  conditions,  or  by  observing  that  the  dual  of 
(DOPT)  is  exactly  the  primal  problem. 

2.8.5  Approximation 

In  the  sequel,  we  wiU  assume  that  CT\  =  62  is  a  finite  impulse  response  sequence.  This 
condition  is  eqtuvalent  to  saying  that  there  exists  a  FIR  feasible  solution  for  (OPT).  If 
this  condition  is  not  satisfied,  then  the  problem  can  be  modified  so  that  the  condition 
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will  hold  [11,  44].  Upper  approximations  of  hq  can  be  readily  obtained  from  the  primal 
problem.  Define  p.^  as  follows: 

pff  =  min^ 

subject  to 

+  #*)  —  /ie  <  0 

V($i  _  $2^  = 

C($i  _  #2)  =  62 

>  0 

4>\i{k)  =  0,  <t>lj{k)  =  OV*  >  iV. 

Since  C  is  constructed  from  FIR  sequences,  this  optimization  wiU  involve  a  finite  number 
of  variables  and  a  finite  number  of  constraints.  It  is  evident  that  is  a  non-increasing 
sequence  satisfying  //o  <  pN  for  aU  N.  Also,  since  a  feasible  FIR  solution  exists,  then 
pH  is  finite  for  JV  large  enough.  Since  FIR  solutions  axe  dense,  it  follows  that  pn  — >  po 
as  N  —*  00.  For  each  pn  a  solution  for  the  primril  problem  can  be  constructed.  The 
difficulty  with  this  procedure  is  that  it  is  not  clear  how  far  the  solution  is  from  optimal  at 
any  given  N.  This  will  be  overcome  by  presenting  lower  approximations  of  the  problem. 

It  is  interesting  to  notice  that  the  dued  of  this  problem  is  obtained  through  truncating 
the  constraints  of  the  dual  problem  (DOPT).  Another  approximation  obtained  from  the 
dual  problem  can  be  obtained  by  truncating  the  variables  ^  €  Cg  [5,  55].  Define  as 
follows: 

p^  =  max  <  bi,a  >  +  <  b2,l3  > 

subject  to 

-  Ar*rj  <  Va  C*/3  < 

m 

i=l 

a  6  B*,  /3  €  eg,  I3{k)  =  OVjfe  >  N. 

It  is  evident  that  <  po  and  that  p^^  —*  po  as  N  —i-  00.  The  former  assertion  is  due 
to  the  fact  that  the  new  problem  has  fewer  degrees  of  freedom,  and  the  later  is  due  to 
the  fact  that  finite  sequences  are  dense  in  cq.  The  above  problem  is  not  immediately 
a  finite- dimensional  problem — the  constraints  due  to  the  operator  V*  are  stiU  infinite; 
however,  only  a  finite  subset  of  these  are  active  as  it  was  in  the  case  where  C  was  equal 
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to  0.  A  complete  discussion  of  the  computation  of  this  problem  is  given  in  [55].  Clearly, 
there  is  no  feasible  solution  for  the  primal  problem  for  any  of  the  £^’s. 

2.8.6  Computations 

In  the  case  where  C  =  0,  the  minimization  problem  is  solved  exactly.  In  all  other  cases, 
only  approximate  solutions  are  obtained  through  obtaining  upper  and  lower  approxima¬ 
tions  of  fio-  The  major  computational  burden  is  in  fact  obtaining  the  operator  V,  since 
it  requires  the  computation  of  the  zeros  of  Tji,  T31  and  their  multiplicities.  Work  on  the 
computational  aspect  of  this  problem  is  in  progress  [24]. 

To  obtain  fast  solutions  that  do  not  necesseirily  capture  the  structure  of  this  problem, 
one  cein  follow  the  approach  in  [3]  in  which  one  seeks  direct  FIE  solutions  for  Q.  This 
problem  can  be  posed  as  a  linear  programming  problem  which  can  approximate  the 
actual  solution  arbitrarily  closely.  However,  unless  one  invokes  duality,  the  difference 
between  the  approximate  and  actual  value  of  fio  remains  unknown. 

It  is  interesting  to  note  that  exact  solutions  for  special  problems  with  C  7^  0  have  been 
constructed  in  [54].  Although  existence  of  -optimal  solutions  is  guaranteed  (under  mild 
conditions,  namely  no  interpolations  on  the  unit  circle),  it  is  not  known  whether  these 
solutions  are  rational  or  not.  If  C  =  0  optimal  solutions  are  FIE,  and  hence  rational. 
The  general  case  is  still  an  active  area  of  research. 

2.9  Conclusions 

This  chapter  gives  an  overview  of  the  problem  of  synthesizing  optimal  controllers  to 
deliver  performsince  specifications  in  the  time  domsdn,  in  the  presence  of  botmded  but 
imknown  exogenous  inputs.  A  general  framework  for  the  robust  performance  problem  is 
presented  from  which  necessary  and  sufficient  conditions  sire  derived.  These  conditions 
were  related  to  the  spectral  radius  of  a  matrix  constructed  from  the  configuration  of 
the  closed-loop  system.  Alternate  equivalent  conditions  are  also  discussed  in  terms  of 
linear  matrix  inequalities.  These  conditions  are  in  turn  used  in  the  synthesis  problem, 
which  requires  the  solution  of  an  optimal  control  problem.  A  solution  of  this  problem 
using  the  duality  theory  of  Lagrange  multipliers  is  used.  This  approach  highlights  in  a 
non-triviai  way  the  relations  between  optimization  problems  for  infinite- dimensional 
systems  and  infinite  linear  programming  problems.  In  fact,  the  solutions  presented  ex- 
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ploit  the  problem  structiire  amd  do  not  rely  on  some  general  theory  for  solving  infinite 
linear  programming  problems,  since  such  a  theory  does  not  exist. 

This  chapter  ^scusses  only  discrete-time  problems.  The  interest  in  discrete-time 
systems  stems  from  the  fact  that  most  controllers  these  days  are  digital  controllers  and 
are  interfaced  with  the  continuous-time  plant  through  A/D  and  D /A  converters.  A  better 
formulation  shotdd  have  a  hybrid  system  consisting  of  both  continuous-  and  discrete-time 
dynamics.  Such  systems  have  recently  received  considerable  attention  from  the  control 
community  and  axe  known  as  sampied-data  systems.  A  formrdation  of  the  £i  sampled- 
data  problem  can  be  found  in  [1,  25,  36,  53]  in  which  it  is  shown  that  synthesizing  a 
digital  controller  for  a  continuous-time  plant  can  be  done  by  solving  a  purely  discrete- 
time  problem.  This  motivates  the  earlier  discussion. 

There  are  other  related  problems  that  are  not  discussed  in  this  chapter.  The  problem 
of  designing  controllers  for  tracking  a  specific  trajectory  is  an  important  problem  and  was 
solved  in  [12].  The  synthesis  approach  has  also  been  extended  for  periodic  and  multi¬ 
rate  sampled  plants  [15].  Also,  this  theory  was  successfully  incorporated  as  part  of  ein 
adaptive  control  scheme,  in  which  the  stability  of  the  closed  loop  system  was  guaranteed 
for  a  larger  set  of  plant  imcertainty  [16,  59].  Finally,  a  case-study  for  the  applicability 
of  this  theory  was  reported  in  [13]  in  which  a  ii  controller  was  designed  for  a  model  of 
the  X  —  29  aircreift. 

A  pressing  research  problem  is  the  understanding  of  the  structure  of  the  optimal 
controllers.  Such  an  understanding  will  not  only  add  insight  into  the  problem,  but  will 
also  offer  simpler  ways  of  computing  the  optimal  solution.  This  has  been  the  case  for 
the  Hoo  and  H2  problems.  Some  interesting  results  in  that  direction  are  reported  in 
[54]  in  which  exact  solutions  for  the  infinite- dimensional  linear  programs  arising  in  some 
special  non-square  problems  have  been  computed.  Also,  it  was  shown  in  [23]  that  optimal 
solutions  may  require  a  dynamic  controller  even  though  all  the  states  are  available.  The 
existence  of  some  sepsuation  structure  of  the  lx  problem  (similar  to  that  of  the  Hoo 
problem  [20])  is  still  under  investigation. 

Another  important  research  direction  is  the  synthesis  problem  by  exactly  minimizing 
the  spectral  radius  function,  rather  than  the  iterative  scheme  suggested.  The  iterative 
scheme  is  guairanteed  to  converge  only  to  local  minima  and  hence  there  is  a  need  for 
looking  for  another  approach  for  minimizing  this  function. 

In  this  chapter,  a  comparison  between  the  spectral  radius  function  and  /x  is  sketched. 
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At  this  point,  it  is  not  known  whether  there  exist  examples  in  which  the  two  methods 
exhibit  extreme  behavior.  Research  in  that  direction  is  currently  in  progress; 
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Chapter  3 


State  Feedback  Optimal 
Controllers  can  be  Dynamic 


This  chapter  considers  ^i-optimal  control  problems  given  by  discrete-time  systems  with 
full  state  feedback,  scalar  control  and  scsilar  disturbance.  Motivation  stems  from  the 
central  role  that  this  problem  structure  played  in  the  development  of  the  Wj  and 
theories.  First,  systems  with  a  scalar  regtilated  output  are  studied  (singular  problems). 
Sufficient  conditions  are  given,  based  on  the  non-minimum  phase  zeros  of  the  transfer 
function  from  the  control  to  the  regulated  output,  for  the  existence  of  a  static  fi-optimal 
controller.  A  simple  way  to  compute  the  static  gain  is  provided,  using  pole  placement 
ideas.  It  is  shown,  however,  that  having  frill  state  information  does  not  prevent  the 
-optimal  controller  from  being  dynamic  in  general,  and  that  examples  with  arbitrarily 
high  order  optimal  controllers  can  be  easily  constructed. 

Second,  problems  with  two  regulated  outputs,  one  of  them  being  the  scalar  control, 
are  considered  (non-singular  problems).  It  is  shown,  by  means  of  a  class  of  fairly  general 
examples  for  which  exact  -optimal  solutions  are  constructed,  that  such  problems  may 
not  have  static  controllers  that  are  -optimal.  Thus  concluding  that  a  “separation 
structme”  does  not  occur  in  these  problems  in  general. 

3.1  Introduction 

Since  Dahleh  and  Pearson  ([10], [11])  presented  the  solution  to  the  tx  optimal  control 
problem,  there  has  been  increasing  interest  in  understanding  the  basic  properties  of  such 
problems  ([5], [44],  [45]  and  [54]).  Considering  that  in  the  case  of  7^2  and  Hoo  optimization 
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([20], [65]),  state  feedback  optimal  controllers  have  a  very  specisd  structure  (i.e.  static), 
it  seems  only  natural  to  ask  how  full  state  information  affects  the  ti  optimal  solution. 
In  particulaTj  under  what  conditions  (if  any)  there  exist  a  static  linear  controller  that 
achieves  optimality.  This  chapter  presents  results  reg«irding  this  question,  for  systems 
with  scalar  control  and  sc^llar  disturbance.  In  particular,  two  diflFerent  types  of  problems 
within  this  class  of  systems  are  considered:  a)  those  with  a  scalar  regulated  output, 
denoted  as  singular  problems,  and  b)  those  with  two  regulated  outputs,  denoted  as  non- 
singular  problems,  where  one  of  the  outputs  is  the  scalar  control  signal.  For  systems 
in  a),  it  is  shown  that  there  exists  a  static  controller  which  is  fi-optimal  if  the  non¬ 
minimum  phase  zeros  of  the  transfer  function  from  the  control  input  to  the  regulated 
output  satisfy  a  simple  algebraic  condition.  Violating  such  condition,  however,  may 
result  in  a  dynamic  fi-optimal  controller  of  possibly  high  order  (generailly  when  the  non¬ 
minimum  phase  zeros  are  “close”  to  the  unit  circle).  For  systems  in  b),  it  is  shown  by 
means  of  an  example  that  optimal  controllers  are  dyneimic  in  a  broad  class  of  cases  which 
are  common  in  control  design.  The  difficulty  in  analyzing  the  non-singrdar  problem  is 
that  it  is  not  straightforward  to  compute  the  optimal  solution,  as  it  is  the  case  with  a 
singular  (i.e.  square)  one.  For  the  given  non-singular  example,  the  optimal  solution  is 
constructed  and  shown  to  require  a  dynamic  compensator. 

The  chapter  is  organized  as  follows.  Section  2  formulates  the  singular  problem  along 
with  some  basic  notation.  Sections  3  and  4  present  results  corresponding  to  singular 
problems  involving  minimum  and  non-minimum  phase  plants  respectively.  Section  5 
examines  a  non-singular  problem  by  means  of  a  general  example,  followed  by  the  con¬ 
clusions  in  Section  6. 

3.2  Problem  Formulation 

Consider  the  following  state-space  minimal  realization  of  a  full  state  feedback  system 
with  scalar  input  disturbance,  scalar  control,  scalar  regulated  output: 


1  ^ 

h 

b2 

Cl 

0 

d\2 

1  ^ 

0 

0 

where  A  €  IR”^",  bi  and  62  €  ci  6  and  du  €  IR.  For  any  internally  sta¬ 

bilizing  controller  k,  let  (f>  =  {<f>{0),(j>{l),^{2),. . .}  denote  the  closed-loop  pulse  response 
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sequence  from  the  disturbance  to  the  regulated  output.  Then,  the  problem  can  be  stated 
as  follows: 

where  ^  Using  standard  results  in  the  parameterization  of  edl  stabilizing 

controllers  (see  [28]),  problem  (3.1)  can  be  rewritten  as  follows: 


infv  11^- w*9=*‘v||i 


(3.2) 


where  indicates  the  space  of  all  m  x  n  matrices  with  entries  in  £i  and  *  denotes 

convolution.  Thus,  h  and  u  £  ii,  and  v  £  Let  the  A-transform  of  a  right-sided 

real  sequence  x  =  {*(0),  a:(l), ®(2), . . .}  be  defined  as 


i(A)  =  f;  *(4)A‘ 

k=0 

where  A  represents  the  unit  delay.  Then,  a  state-space  realizations  for  h,  u  and  v  can  be 
found  by  using  the  state-space  formulas  in  [28]  with  the  observer  gain  matrix,  H,  equal 
to  —A.  For  this  specific  choice,  the  realizations  are: 


h(A)  = 

A  [Ay,  A  bi,  Cl  -t-  di2f,  ci6i] 

(3.3) 

ti(A)  = 

[Ay,  62,  Cl  -f  di2f,  di2] 

(3.4) 

u(A)  = 

[0, 61,  J,  0]  =  A  61 

(3.5) 

where  h{\),  u{X)  and  v{X)  denote  the  A-transform  of  h,  u  and  v;  Af^=  A  A  /, 

[A,  B,  C,  D]  XC(I-  XA)-^  B  +  D 


and  /  is  chosen  so  that  all  the  eigenvalues  of  Ay  cire  inside  the  unit  disk. 

The  following  result,  which  will  be  needed  in  the  next  section,  is  proved  in  [10] 

Theorem  3.2.1  Assuming  ■&(•)  and  v(-)  have  no  left  and  right  zeros  respectively  on  the 
unit  circle,  there  exists  qopt  6  that  achieves  the  optimal  norm  in  problem  (3.2). 

Moreover,  the  closed-loop  optimal  pulse  response,  <j)opt  =  h.—u*qopt  *v,  has  finite  support. 


3.3  Singular  Problems  with  Minimum-Phase  Plants 

This  section  considers  the  case  where  the  transfer  function  from  the  control  input  to 
the  regulated  output  is  minimum-phase  except  for  an  integer  number  of  unit  delays 
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(i.e.  zeros  at  the  origin  in  the  A-plane).  It  will  be  assumed  throughout  that  [A,  62)  is 
reachable. 

Theorem  3r3.1  For  such  a  system,  the  static  feedback  gain,  f*,  that  places  the  eigen¬ 
values  of  (A  +  h  /*)  3.t  the  exact  location  of  the  minimum-phase  zeros  of  [A,  b2,ci,  ^12] 
and  the  rest  at  the  origin  is  fi-optimal. 

Proof.  Consider  using  /*  as  the  state  feedback  gain  in  the  psurameterization  described 
above.  Then,  after  csirrying  out  all  stable  pole-zero  cancellations, 

u(A)  =  7r  A’’ 

where  r  is  the  number  of  unit  delays  in  [A,  621  Ci?  du]  and  7r  is  a  scalar  depending  on  r. 
In  what  follows,  the  cases  where  r  =  0  and  r  >  0  will  be  treated  separately. 

i)  If  r  =  0,  then  di2  7^  0,  ci  +  di2  /*  =  0)  and  u(A)  =  di2-  Also,  from  equation  (3), 

h{X)  =  Cl  61  A  =  (ci6i  -f-  di2f*bi  —  di2f*bi)X  =  —d\2f*bi 

^{X)  =  -diar&iA  -  di29(A)&aA 

Thus,  the  ^i-optimal  solution  is  given  by  qopt{X)  =  -/*,  and  <^opt(A)  =  0.  Furthermore, 
using  the  state- space  equations  in  [28]  for  computing  the  optimal  controller,  it  can  be 
shown  after  a  little  algebra  that  koptW  =  /*. 

ii)  If  r  >  0,  then  di2  =  0,  ciA^.  =  0  by  construction  since  (A,  62)  is  reachable.  Also 
u(A)  =  ciily7^&2  A*".  Again,  from  equation  3, 

h{X)  =  C161A  -f  ciAbiX^  -b  ciAfAbiX^  -b - b  ciAyT^  A6iA’’'*'^ 

Therefore,  the  closed-loop  pulse  response  is  given  by 

(^(A)  =  cib\X  -b  ciA^iA^  -b  CiAf»Ab\X^  "b  •  •  * 

+  ciA}7^6iA"  +  ciA^tHA  -  b2q{X))bxX^-^^ 

Clearly,  q  does  not  affect  the  first  r  -b  1  elements  of  <j>  (i.e.  ^(i),  i  =  0, 1, . . .,  r).  Then, 
the  best  possible  choice  of  q,  in  the  sense  of  minimizing  the  fi-norm  of  <f>,  is  the  one  that 
makes  ^(i)  =  0  for  i  =  r  -b  1,  r  -b  2, . . .,  and  is  achieved  by  letting  qopt{^)  =  -/*»  since 
<p{r  +  1)  =  ciA^.61  =  0.  Agjiin,  the  corresponding  fi-optimail  controller  is  /*.  I 
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Corollary  3.3.1  The  £i -optimal  closed-loop  transfer  function  of  the  system  considered 
in  Theorem  3.3.1  (with  r  >  0)  is  given  by: 


i=l 


Proof.  It  follows  from  the  fact  that  ciAf.b^  =  0  for  i  =  0, 1, . . . ,  r  -  2.  The  details  are 
left  to  the  reader.  I 


Put  in  words,  Theorem  3.3.1  says  that  there  is  nothing  the  controller  can  do  to  invert 
the  delays  in  the  system.  It  can,  however,  cancel  the  rest  of  the  dynamics  of  the  system 
due  to  the  absence  of  non-minimum  phase  zeros  in  the  trainsfer  fxmction  from  the  control 
input  to  the  regulated  output.  This  results  in  an  optimal  closed-loop  pulse  response  that 
is  equal  to  the  open  loop  pulse  response  in  its  first  (r  -f  1)  elements  and  zero  thereafter. 
It  is  also  worth  noting  that  Theorem  3.3.1  is  directly  applicable  to  the  discrete-time 
LQR  problem,  where  J]),-  (j>^  is  minimized.  More  precisely,  the  asymptotic  LQR  solution 
(see  [40])  where  the  weight  on  the  control  tends  to  zero  (i.e.  cheap  control  problem)  is 
identical  to  that  of  Theorem  3.3.1. 

3.4  Singular  Problems  with  Non>minimum  Phase  Plants 

This  section  considers  those  cases  where  [A,  b2,  Ci,  di2]  has  r  non-minimum  phase  zeros 
not  necessarily  at  the  origin  (i.e.  A  =  0). 

Again,  we  use  the  same  parameterization  as  in  the  previous  section.  That  is,  we 
choose  /*  to  place  (n  —  r)  eigenvalues  of  A^  at  the  exact  location  of  the  minimum  phase 
zeros  of  [A,  62,  ci,  c?i2]  and  the  rest  (r)  at  the  origin.  Then,  from  the  discussion  in  section 
3,  h(X)  is  polynonaial  in  A  and  of  order  (r  -f  1),  ti(A)  is  polynomial  too,  but  of  order  r, 
and  v(X)  is  simply  A  61.  Therefore,  the  closed-loop  transfer  function  can  be  written  as 
follows: 

<^(A)=  |ffin(^-ai)-p2n(A-/3i)g-(A)j  a1^'^  (3.6) 

where  gi,g2  €  IR,  ot{’s  are  the  zeros  of  h,  /3_,’s  are  the  (non-minimum  phase)  zeros  of 
u  and  [A,b2,ci,di2],  and  g(A)  1=^  9(A) 61  G  li.  Note  that  ||^||i  =  Also,  by 

Theorem  3.2.1,  ^„pt(A)  is  polynomial  in  A,  which  implies  that  qgptiX)  is  polynomial  in 
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A.  Thus,  the  optimization  problem  is  equivalent  to  the  following  linear  programming 
(primed)  problem:  for  a  sufficiently  leurge  but  finite  s, 

S 

(3.7) 

^  i=0 

s  r 

s.t.  =  91  -  a.)  »  i  =  2, . . . ,  r 

t=0  t=l 

In  the  above  we  have  assumed  that  the  /3j’s  are  simple  zeros  to  simplify  the  formulation 
of  the  interpolation  conditions.  The  following  results,  however,  carry  over  to  the  more 
general  case. 

The  following  theorem  by  Deodhare  and  Vidyasagar  [17]  will  prove  useful.  It  is  stated 
with  no  proof. 

Theorem  3.4.1  The  support  of  ^  in  (3.7),  denoted  as  (s  +  1),  equals  the  number  of 
constraints  r,  if 

r  — 1 

^|ai|<l  (3.8) 

»=o 

where  nj=i('^  -  i^i)  =  +  •  •  •  +  oiA  +  cq. 

Now  we  are  ready  to  present  the  next  result. 

Theorem  3.4.2  Let  [A,b2,ci,d\2]  have  r  non-minimum  phase  zeros,  then  if  (3.8)  is 
satisfied,  f*  is  ii -optimal. 

Proof.  By  Theorem  3.4.1,  ^opt(A)  is  of  order  (r  —  1).  Then,  considering  the  order  of 
each  term  in  (3.6),  it  is  clear  that  gopt(A)  has  to  be  constant  and  such  that  ^{r)  =  0. 
Using  the  state-space  formulas  (3),  (4)  and  (5), 

0  =  ^(r)  =  {cf\-di2nA}:HAbi-b2q^tiO)) 

=  {ci  +  dunA}7HA-b2qoptmbi 

But,  by  construction,  (ci  -|-  ^12/*)^/.  =  0  due  to  the  stable  pole-zero  cancellations  and 
the  fact  that  the  rest  of  the  poles  are  placed  at  the  origin.  Therefore,  q^pt  =  — /*  is  the 
required  value,  and  k„pi  =  /*.  I 

Observation:  It  remains  to  consider  those  cases  where  the  non-minimum  phase  zeros 
of  [.4,62,01,^12]  are  such  that  they  violate  condition  (3.8).  Theorem  3.4.1  established  a 
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sufficient  condition  to  determine  the  order  of  the  optimal  response.  If  (3.8)  is  violated, 
the  optimal  closed-loop  response  may  be  of  higher  order,  possibly  greater  than  n,  but 
stiU  polynomial.  If  that  is  the  case,  then  the  fi-optimed  controller  is  necessarily  dynamic, 
since  the  highest  order  polynomial  response  that  a  static  controller  can  generate  is  n  by 
placing  all  closed-loop  poles  of  the  plant  at  the  origin.  Any  polynomial  response  of  order 
greater  than  n,  say  N,  requires  a  dynamic  compensator  of  at  least  order  N  —  n.  Thus, 
12i=Q  l°tl  ^  viewed  as  a  necessary  condition  for  the  optimal  controller  to  be 

dynamic. 

The  following  example  shows  that  a  large  class  of  state  feedback  singular  problems 
have  this  property. 

Example  1:  Consider  the  following  parameterized  family  of  plants  (with  parameter 

A(«A^-2.5A-H) 

’  (l-0.2A)(23A2-2.5A-f  1) 

Assume  that  the  controller  has  access  to  the  state  vector  and  that  the  disturbance  acts 
at  the  pleint  input.  The  non-minimum  phase  zeros  relevant  to  this  theory  are  given  by 
the  roots  of  /cA^  —  2.5A  4- 1,  as  a  function  of  «.  It  is  easy  to  see  that  for  k  >  3.5  condition 
(3.8)  is  satisfied  and  the  optimal  controller  is  /*.  By  applying  the  methods  of  [10],  it 
can  be  shown  that  for  k  =  3.5  the  optimal  solution  is  no  longer  unique.  Actually  two 
possible  solutions  with  ||<^opt|li  =  7  are: 


«_3.s  — 


A  -  2.5A2  -p  3.5A3 
A  -  1.1A2  +  4.9A'‘ 


The  first  is  achieved  with  f*  while  the  second  requires  a  first  order  controller.  (The 
non-uniqueness  is  related  to  the  occurrence  of  weakly  redundant  constraints  in  the  linear 
program.)  Note  that  for  this  value  of  k,  the  left  hand  side  of  (3.8)  is  equal  to  one. 

For  1.5  <  K  <  3.5  condition  (3.8)  is  violated  and  the  optimal  solution  has  the  following 
general  form: 


As  K  \  1.5,  one  of  the  non- minimum  phase  zeros  approaches  the  botmdary  of  the  unit 
disk  while  <^,((2)  — >  -1.5,  ^«(iVK)  — >  0.5,  and,  most  remarkably,  Z'  oo.  This 
implies  that  the  optimal  controller  can  have  arbitrarily  large  order.  For  instance,  if 
K  =  1.51,  then 

<^optK=i.M  -  ^  -  1-4907A2  0.5776A12 
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and  the  optimail  c6mpehsa,t6f'is  dfordef’  9.~IOs~als6  ihtefestih^to  poiiii  duf'thaF'for 
K  <  1.5  one  of  the  non-minimum  phase  zeros  leaves  the  unit  disk  and  condition  (3.8)  is 
again  satisfied.  In  this  case,  =  A  —  1.5A^  and  =  /*.  With  regard  to  the 

optimal  norm,  it  drops  from  a  value  arbitrarily  close  but  greater  than  3  to  a  value  of  2.5 
in  the  transition. 

Similar  behavior  has  been  reported  in  [46],  for  the  case  of  sensitivity  minimization 
through  output  feedback.  The  above  example  shows  that  the  nature  of  such  solutions 
have  comparable  characteristics  even  under  full  state  feedback.  There  is  one  difference, 
however,  which  reflects  the  structure  added  to  the  problem.  In  [46]  a  parameterized 
family  of  first  order  systems  was  constructed  with  arbitrarily  high  order  optimal  con¬ 
trollers,  while  this  setup  requires  at  least  a  second  order  plant  with  two  non-minimum 
phase  zeros  away  from  the  origin.  Note  that  condition  (3.8)  is  automatically  satisfied 
otherwise. 

3.5  A  Non-Singular  Problem 

So  far  we  have  considered  problems  with  a  scalar  regulated  output.  One  could  argue  that 
sensitivity  minimization  problems,  such  as  the  one  in  the  above  example,  where  a  measure 
of  the  control  effort  is  not  included  in  the  cost  functional  (i.e.  singular  problems),  may 
have  peculiar  solutions  that  could  hide  the  structure  of  the  more  general  non-singular 
case.  To  clarify  this  point,  we  will  consider  a  variation  of  the  above  example  by  including 
the  control  effort  in  the  cost  functional.  That  is, 

inf,  ”^a«(!l<?^i|li.7il'^2|li)  (3.9) 

k—$iah,  1^2  j  k^stab, 

where  represents  the  closed-loop  map  from  the  disturbance  to  the  output  of  the  plant, 
<f>2  represents  the  closed-loop  map  from  the  distmbance  to  the  control  input,  and  7  is  a 
positive  scalar  weight.  The  fact  that  there  are  two  regulated  outputs  and  only  a  scalar 
control  makes  this  problem  of  the  had  rank  class  (i.e.  two-block  column  problem,  see  [11] 
and  [44]).  This  implies  that  a  linear  programming  formulation  of  the  solution  wiU  have, 
in  general,  an  infinite  number  of  non-zero  variables  and  active  constraints  (Theorem 
3.2.1  no  longer  holds)  making  the  construction  of  exact  solutions  a  non  trivial  task.  For 
the  following  example,  however,  it  is  shown  that  the  optimal  response  has  finite  support, 
and  that  an  exact  solution  can  be  computed  by  the  methods  in  [54]  and  [24]. 
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Example  2:  Consider  problem  (3.9)  for  the  parameterized  family  of  plants  of  Ex¬ 
ample  1.  By  expanding  each  term,  Equation  3.9  can  be  rewritten  as: 


II  = 


inf 


hi 

■yh2 


Ui 

7«2 


*  5  *  ull 

1 


(3.10) 


where,  according  to  the  previous  peirameterization  (and  using  the  same  notation). 


hi(A)  —  \[Af,Ahi,ci-\-di2f*,cibi] 
h2{\)  =  \[Af.,Abi,f*,Q] 
wi(A)  =  [A/.,62)Ci  +  di2/*»di2] 

U2(A)  =  [A/.,62,/*,1] 

v(A)  =  A6i 


(3.11) 


With  the  particular  problem  data  and  k  =  2,  u(A)  has  a  right  zero  at  the  origin  and 
(ui(A)  7U2(A))^  has  no  left  zeros.  Then,  the  optimization  problem  can  be  posed  in  the 
primal  space,  fi,  as  follows  ([11]): 


subject  to: 


a  =  inf  I 


<t>i 

i4>2 


1 


=  0 
=  0 

{u2  *  <j>i  —  ui  *  <f)2){k)  =  {u2  *  hi  —  ui  *  h2){k),  fc  =  0,1,2,... 

Or  in  the  dual  space,  Igo,  as 


OO 

/j,  =  sup  ^  a(i)(u2  *  hi  —  ui  *  h2){i) 
O‘,)3l,02<n,T2  i—Q 


(3.12) 


(3.13) 


(3.14) 


subject  to: 

l(£t”o«(*  +  ^)«2(i))  + {o*')Al  <  n 

l(E»~o«{*  +  *)«i(0)- (0'')/32|  <  7-2  (3.15) 

n  +  t2  <  1 

for  ^  =  0, 1, 2, . . .,  where  a  6  foo  and  I3i,(32,  n,  T2  6  H. 

Let  Jiff  denote  the  value  of  (3.12)  when  the  constraints  4>i{k)  =  0  for  aU  ib  >  iV,  t  =  1, 2 
are  appended  to  (3.13),  and  let  jx^  denote  the  value  of  (3.14)  when  the  constraints 
a(fc)  =  0  for  all  Ai  >  M  are  appended  to  (3.15).  Then,  clearly 


^  ^  Miv 


(3.16) 
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for  all  positive  integers  M  and  N.  We  will  refer  to  these  problems  as  the  truncated  primal 
and  the  truncated  dual  problem  respectively.  Next,  let  7  =  0.1,  N  =  5  and  M  =  13,  then 
the  following  are  exact  solutions  to  the  truncated  primal  and  truncated  dual  problems 
(within  15  digits  accuracy): 


MX)  = 

(^2(A)  = 


887 \2  I  631  \4  ,  308  \5 
558^'  +  558'^  558'' 

998.6  \  ,  11895.4 12  ,  8955.4  \3  i  1282.2  \4 
658  558  "V  568  558 


708.4  1  5 
668 


f  Ti  ^ 
7-2 

I3i 

/32 

a(0) 

a(13) 

0 


/  0.970131421744327  \ 

0.0298685782556741 
18.1617920759050 
42.7538829151732 
0 

37.7844820452347 

-3.29789187316069 

-1.65259869560944 

-0.401868143803625 

0.309029878922354 

0.572287131426917 

0.545909685694633 

0.411177830532670 

0.255951734446358 

0.129285041919450 

0.0273249362257737 

-0.0155520615496705 

-0.0181682559221378 

0 


/ 


(3.17) 


(3.18) 


It  is  easy  to  verify  using  the  values  in  (3.17)  and  (3.18)  that  =  1192/279  ~ 

4.2724,  thus,  from  (3.16),  p  =  1192/279  and  (3.17)  is  the  exact  solution  to  the  full  primal 


problem  (3.12).  Therefore,  since  such  solution  has  finite  support  and  is  of  fifth  order. 


the  optimal  controller  is  necessarUly  dynamic  and  of  second  order.  Also  note  that  the 
optimal  closed  loop  response  is  such  that  =  7ii<;^2||  =  M- 

It  is  also  interesting  to  consider  the  singtdar  problem  corresponding  to  this  example 
(i.e.  K  =  2  and  7  =  0).  The  optimal  solution  (which  is  obtained  by  eliminating  the 
second  row  and  solving  the  resulting  good  rank  problem)  is  given  by: 


^i(A)  -  A-||A2  +  ^A® 

<^2{A)  =  -m§A+H|SA=>  +  lf|^A3  +  li|6A4_l||iA^ 


(3.19) 
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where  =  286/68  4.2059  while  =  4374.4/68  ~  64.3294  is  clearly  larger 

since  it  was  left  out  of  the  optimization.  In  fact,  the  above  solution  is  valid  for  7  6 
[0,286/4374.4]  since  for  any  7  in  such  interval  ||<^illi  >  7ll<^2|li'  Moreover,  for  any 
such  7,  the  ^i-optimal  controller  is  dynamic  and  of  second  order  since  the  optimal  4>i  is 
polynomial  and  of  fifth  order.  This  alone  constitutes  a  family  of  problems,  parameterized 
by  7  6  [0,286/4374.4],  requiring  dynamic  optimal  controllers. 

AU  this  indicates  that  given  a  non-singular  (two-block)  problem,  the  optimal  con¬ 
troller  may  very  well  be  dynamic,  whether  or  not  the  two  regulated  outputs  impose 
conflicting  goals  (i.e.  active  constraints).  Further,  it  can  be  shown  that  even  when  the 
corresponding  singular  problem  has  a  static  optimal  controller,  the  non-singtilar  prob¬ 
lem  may  require  a  dynamic  one.  This  will  happen  only  if  7  is  large  enough  to  make  the 
second  row  of  the  cost  functional  active  in  the  optimization. 

A  last  question  remains  to  be  answer:  given  a  full-state  feedback  problem  with  a 
dyneimic  -optimal  controller,  is  it  possible  to  find  a  static  controller  that  achieves  an 
^i-norm  arbitrarily  close  to  the  optimal?  Again,  it  is  easy  to  show  via  a  cormter  example 
(numerical)  that  this  is  not  the  case.  In  fact,  a  simple  second  order  problem  can  show 
that  the  gap  between  the  norms  achieved  by  the  optimal  and  the  static-optimal  controller 
can  be  significant. 

3.6  Concluding  Remarks 

This  chapter  presented  a  study  of  the  ii  optimization  problem  for  systems  with  full 
state  feedback,  scalar  disturbance  and  scalar  control.  Two  classes  of  problems  were 
considered:  a)  singtilar  problems  with  a  scalar  regulated  output,  cind  b)  non-singular 
two-block  problems  with  two  regulated  outputs,  one  of  them  being  the  control  sequence. 
The  main  purpose  of  the  study  was  to  determine  whether  or  not  there  is  always  a  static 
controller  which  is  -optimal.  In  the  case  of  singular  problems,  a  sufficient  condition  was 
given,  based  on  the  non-minimum  phase  zeros  of  the  transfer  function  from  the  control 
to  the  regulated  output,  for  the  existence  of  a  static  fi -optimal  controller.  The  optimal 
gain  is  such  that  it  places  a  subset  of  the  closed-loop  poles  at  the  exact  location  of 
the  minimnm  phase  zeros  of  the  transfer  function  from  the  disturbance  to  the  regxdated 
output  and  the  rest  at  the  origin.  Then,  it  was  shown  by  means  of  general  examples,  that 
both  singular  as  well  as  non-singtilar  problems  may  require  dynamic  optimal  controllers 
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of  Eirbitrarily  high  order,  in  spite  of  the  perfect  state  information.  This  adds  to  the 
observations  made  in  [46]  where  singular  problems  with  output  feedback  were  considered. 
In  fact,  it  can  be  shown  using  similar  arguments  that  full  information  problems  (where 
the  disturbemce  is  measured  exactly)  also  have  these  characteristics. 

Although  the  systems  in  question  were  simple,  it  is  safe  to  conclude  that  more  com¬ 
plex  MIMO  state  feedback  i\  optimization  problems  will  also  have  these  chsiracteristics 
in  general.  Therefore,  it  is  doubtful  that  the  study  of  the  full  state  feedback  problem  will 
render  a  “separation  structure”  similar  to  the  ones  found  in  "Ki  and  optimization 
theory  ([20],  [65]). 
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Chapter  4 


Rejection  of  Persistent  Bounded 
Disturbances:  Nonlinear 
Controllers 


This  chapter  considers  nonlinear  time-vairying  (NLTV)  compensation  for  linear  time- 
invariant  (LTI)  plants  subject  to  persistent  bounded  disturbances.  It  is  shown  using  two 
dilFerent  approaches  that  using  NLTV  compensation  instead  of  LTI  compensation  does 
not  improve  the  optimal  rejection  of  persistent  bounded  disturbances.  The  first  approach 
is  to  derive  a  botmd  on  the  achievable  performance  over  aU  stabilizing  NLTV  controllers. 
Using  results  from  fi-optimal  control,  it  follows  that  in  some  special  cases  this  bound 
can  be  achieved  by  LTI  compensation.  This  approach  involves  the  introduction  of  an 
operator  analogous  to  the  Hankei  operator  in  -optimal  control  and  is  of  independent 
interest.  The  second  approach  is  to  assume  the  NLTV  controller  is  sufficiently  smooth 
to  admit  a  time-varying  linearization.  This  time-varying  linearization  is  then  used  to 
construct  an  LTI  controller  which  achieves  the  same  performance  as  the  original  NLTV 
controller.  These  resffits  extend  previous  work  by  the  authors  regarding  linear  time- 
varying  compensation. 
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Notation 

LTI  :=  linear  time-invariant 
LTV  :=  linear  time-varying 
NLTV  :=  nonlinear  time- varying 


|/  =  (. . . ,  /(-I),  /(O),  /(I),  /(2), . . .)  :  ll/IL  sup  |/(n)|  <  00} 
:=  {/  e  ^oc  :  /(n)  =  0,Vn  <  0} 

4  :=  |/ 6  ^oc:||/||/=E  !/(”)!<  «^} 

c°=  (/e£“|  Urn  i(ib)  =  o| 

l.  fc— »oo  j 


Ill’ll  :=  sup 


liT/ll, 


il/IL 

f¥<> 

n./(n)  =  I  "S"' 

\  0,  n  >  0. 


4.1  Problem  Statement 


In  this  chapter,  we  consider  the  use  of  NLTV  compensation  to  achieve  optimal  distur¬ 
bance  rejection  with  LTI  plants.  This  problem  has  been  considered  in  [2,  27,  37,  39,  51]. 
In  [27,  37,  39],  it  was  shown  that  NLTV  compensation  does  not  improve  the  optimal  rejec¬ 
tion  of  finite-energy  (i.e.,  disturbances.  In  [51],  it  was  shown  that  LTV  compensation 
does  not  improve  the  optimal  rejection  of  persistent  bounded  (i.e.,  £00)  disturbances. 
This  was  extended  to  continuous-time  systems  in  [2].  Possible  advantages  of  NLTV 
control  are  discussed  in  [38]  and  references  contained  therein. 

The  results  of  [2,  51]  hold  for  LTV  compensation  only.  In  this  chapter,  we  consider 
nonlinear  compenstation  with  persistent  botmded  disturbances.  It  is  shown  using  two 
approaches  that  NLTV  compensation  again  does  not  improve  the  optimal  disturbance 
rejection  of  disturbances.  The  first  approach  involves  the  introduction  of  an  operator 
analogous  to  the  Hankel  operator  in  H°®-optimal  control  which  is  of  independent  interest. 
This  operator  leads  to  a  bound  on  the  achievable  performance  which  can  be  achieved  by 
LTI  compensation.  The  second  approach  uses  a  linearization  of  the  nonlinear  controller 


53 


to  construct  an  LTI  controller  which  achieves  the  same  performaince  as  the  original  NLTV 
controller. 

In  the  discussion  that  follows,  familiarity  with  the  disturbance  rejection  problem 
framework  and  related  notions  of  stabilization,  causality,  and  well-posedness  is  assumed 
(cf.,  [28,  60]).  In  particular,  unless  otherwise  specified,  all  operators  are  norm-bounded 
causal  mappings  over  signals  with  support  (-00,  oo). 

To  set  up  the  problem,  let  Tzw{K)  denote  the  closed-loop  mapping  from  the  exoge¬ 
nous  disturbances,  w,  to  the  regulated  variables,  z,  as  a  function  of  the  controller  K. 
Let  A/rv  denote  all  norm-bounded  causal  NLTV  operators  on  fco-  Let  Cjv  denote  the 
subset  of  A/rv  which  are  linear.  Similarly,  let  Cti  denote  the  subset  of  Ctv  which  are 
time-invariant.  The  A  transform  of  an  element  H  6  Cti  wiU  be  denoted  by  H{X).  It  can 
be  shown  (cf.,  [28,  56])  that  the  problem  reduces  to  comparing  the  following  quantities: 


MiVL  =  inf  {||Tjti,(iiL')||  :  K  is  any  stabilizing  NLTV  controller} 

fiTV  inf  {||T’2,4,(iir)||  :  K  is  any  stabilizing  LTV  controller} 
=  ^inf  IIT1-T2QT3II. 


fiTi  =  inf  {||r5TO(^L’)||  :  K  is  any  stabilizing  LTI  controller} 

=  inf 

Here,  Ti,2,3  €  Cti  are  discrete-time  multiple-input /multiple-output  systems  deter¬ 
mined  by  the  discrete-time  LTI  plant  and  disturbance  rejection  problem  under  considera¬ 
tion.  In  the  remednder  of  this  chapter,  any  extra  assumptions  on  Ti_2,3  wiU  be  introduced 
as  needed. 

The  following  theorem  concerns  LTV  compensation: 

Theorem  4.1.1  ([51])  fiTV  =  f^Tl- 

In  this  chapter,  we  show  that  tmder  certain  conditions  fiffi  =  ^ti- 
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4.2  Main  Results 

4.2.1  A  Hankel-like  Operator 

In  this  section,  a  Hsinkel-like  operator  (cf.,  [28])  is  defined  for  general  operators  on  igo- 
This  Hankel-like  operator  leads  to  a  lower  bound  on  the  achievable  performance  over 
NLTV  compensators.  In  the  specisd  case  where  Tj  =  I,  it  is  shown  that  this  boimd 
may  be  achieved  by  an  LTI  compensator.  In  this  section,  Ti,2,3  are  assumed  to  be 
single-input/single-output  with  the  exception  of  Exeimple  2.2. 

Let  Gi, . . . ,  a„,  bi,.  ..,bm  be  the  zeros  of  the  transfer  functions  of  T2  and  Tz  respec¬ 
tively  inside  in  the  open  unit  disc.  For  simplicity,  assume  they  are  real  and  distinct.  The 
forthcoming  analysis  still  goes  through  in  the  general  case.  Define  the  functions 

Ua.{k)  =  aj^  V*  <  0,  j  =  1,.  ..,n 

Vbjik)  =  bj’‘  VA:  <  0,  j  =  1, . . . ,  m 
Let 

U  =  span{uai} 

V  =  9pan{vbj} 

U  and  V  are  subspaces  inside  foo  supported  on  the  nonpositive  integers.  Given  any 
operator  H  on  f*,?  define  a  Heinkel-like  operator  as  follows 

Th  :  +  V  foo 


u  -f-  t;  — ♦  n_(u  *  He  4-  e  *  Hv) 


where  n_  denotes  the  projection  on  the  nonpositive  integers,  *  denotes  convolution,  and 
e  denotes  the  unit  pulse  at  the  origin, 


A:  =  0; 
fc  #  0. 


In  the  case  of  an  LTI  operator  H,  the  operator  has  a  simple  representation.  Let 
u  -I-  r  6  +  V,  then 

n  m 

u  +  v  =  aiUg.  -I-  ^  0iVb. 
t=i  t=i 
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and 

n  m 

n_(H(u  +  v))  = 

t=l  i=l 

The  norm  of  Th  is  defined  as 

IIP  II  cifr\  I  1^^/!  |c» 

ll^■ff  II  sup 

/6W+V,/9^0  ||7l|oo 

In  the  case  where  H  is  LTI,  this  norm  csoi  be  computed  exactly  via  solving  a  linear 
programming  problem.  This  is  captured  in  the  following  proposition. 

Proposition  4.2.1  Let  H  be  an  LTI  operator  with  X-transform  H.  Then 


\\TH\\  =  max^aiH{ai)  +  '£l3iH{bi) 


subject  to 


<x%Q  . 

t=i 


Eat-af  +  E^‘“^ 

i=l  j=l 


1=1 


<  1,  Vfc  >  0. 


Proof.  By  direct  computation, 


lirirli  = 

a,p  k<0 


^aiH{ai)ar’^  +  '£0iH{bi)b 

i=l  i=l 


-k 


subject  to 


t=i  t-i 


<  1,VA:  <  0. 


It  remains  to  be  shown  that  the  function  to  be  maximized  achieves  the  maximum  at 
k  =  0.  To  prove  this,  assume  it  achieves  the  maximum  at  k  =  k*.  Let  dj  =  , 

.  Then  &i,^i  are  feasible  solutions  which  gives  the  same  value  at  A:  =  0.  I 


The  following  theorem  establishes  the  connection  between  -optimal  control  and  the 
above  Hankel-like  operator. 

Theorem  4.2.1  {[10]) 

PTI  =  lirTxll- 
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It  is  interesting  to  notice  that  when  Q  is  LTI,  one  can  easily  show  that  l|rrj|  is  a 
lower  bound  for  uti  as  follows.  Let  §  =  Ti  -  T2QT3  with  impulse  response  Then 

1|$|1  =  ItTi  -  Tj^ral!  >  sup  |tn_(u*^*e)  +  n_(e*<^*t;)|U 

u6W,«6V,j|«  +  v|l^<l 

=  lirrJU 

This  lower  bound  is  not  valid  in  general  if  Q  6  Mrv-  This  poses  a  serious  problem 
in  proving  the  general  result  we  desire.  In  the  special  case  where  Tj  =  /  (and  hence 
U  =  Q),  the  lower  bound  is  valid  and  the  desired  result  can  be  proved.  Of  course  this 
includes  the  case  where  is  stable. 

Theorem  4.2.2  If  T2  =  /  then  =  fixi- 

Proof.  For  all  u  G  V  with  |!v||^  <  1, 

IIT1-QT3II  >  iin_(ri-gT3)u|u 

=  iin.Tit;  -  n_(3n_T3u|U  =  lin.riuiioc 

The  above  is  true  since  T3(&j)  =  0.  Hence, 

iira-QT3||>||rrJ|  =  m 

However,  the  lower  bound  is  achieved  by  an  LTI  Q.  I 

While  the  conditions  of  Theorem  2.2  are  not  the  most  general,  there  are  in  fact  some 
interesting  problems  in  which  T2  has  a  stable  inverse.  Below  are  a  few  ex2unples. 

Example  4.2.1  Weighted  input-sensitivity  minimization  for  a  stable  plant. 

The  map  from  the  reference  input  to  the  input  of  the  plant,  with  a  controller  in  the 
feedback  loop,  is  given  by  Si  =  W\{I  4-  KP)~^W2-  Incorporating  the  parameterization 
of  all  stabilizing  controllers,  5,  is  given  by 

Si  =  Wx{I  -  QP)W2 

Both  Wi  and  W2  are  assumed  to  have  a  stable  inverse.  The  result  above  implies  that 
nonlinear  controllers  will  not  offer  any  advantage  in  tracking  problems  with  stable 
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plants.  The  parallel  result  for  output  sensitivity  is  still  open. 


Example  4.2.2  Robust  stability  with  coprime  factor  perturbations.  There  is 
an  important  reason  for  considering  this  excimple.  Even  though  the  result  we  presented 
earlier  is  for  the  square  case,  it  is  stiU  valid  for  the  non-square  case,  i.e  for  the  case  where 
T3  is  a  row  vector.  In  this  example  we  will  sketch  the  proof  of  this  result  in  this  special 
problem.  The  general  non- square  case  follows  in  the  same  way. 

Define  the  following  class  of  plants: 

n  =  {P\P  =  {N  +  A2)(M  +  Ai)-i  and  ||Ai||  <  1} 

with  Aj  being  f“  boimded  LTV  operators  and  Po  =  NM~^  satisfying  the  Bezout  identity 

(  V  U  ']  (  M  -U  \  _  (  I  q\ 

\  N  M  )  \  -N  V  )  ~  \  0  I  ) 

A  sufficient  condition  for  robustly  stabilizing  the  above  family  with  any  NLTV  controller 
is  given  by 

^i^^J|[F  U]  +  Q[N  M]i|<l 

This  condition  is  also  necesseury  if  the  controllers  are  restricted  to  be  linear,  possibly 
time-varying  [5,  51].  The  necessity  of  this  condition  for  NLTV  controllers  is  as  follows. 
First,  the  underlying  notion  of  stability  is  finite-gain  stability  over  c°  rather  than  f”. 
Second,  the  operator  Q  is  restricted  to  be  continuous  and  have  pointwise  fading-memory 
[52]. 

We  note  that  the  construction  in  [5,  51,  52]  leads  to  a  construction  of  admissible  LTV 
A,-  such  that  either  of  the  following  conditions  occurs.  The  first  condition  is  that  the 
plant  {N  -)-  A2)(M  -f  Ai)~^  has  an  internal  cancellation.  That  is,  the  operators  M  +  Ai 
and  iV  -1-  A2  are  no  longer  coprime.  This  corresponds  to  an  admissible  plant  which  is  not 
stabilizable.  The  second  is  that  the  admissible  plant  {N  ■+■  A2)(M -f-  Ai)~^  is  stabilizable, 
but  not  using  the  peirticular  Q  with  the  property  ||[F  U]  -|-  Q[N  M]\\  >  1. 

It  turns  out  that  above  infimization  is  achieved  via  a  linear  time-invariant  Q.  Define 
the  subspace  V  (inside  x  £°°)  as  follows: 

V  =  {u  =  ^  x,  X  e  c°,  x(k)  =  0  yk  >  1} 
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Then  for  any  Q  €  Afrv  and  r  6  V,  it  is  true  that 


||[F  U]  +  Q[N  =  ||«i|oo  >  |®(0)| 


Equivalently, 

\\[V  U]  +  Q[N  M]||>3npl^ 

«GV  l!n|U 

which  was  shown  in  [5]  to  be  achieved  by  an  LTI  Q.  The  generalization  to  arbitrary  T3 
follows  in  a  similar  fashion.  I 


So  far,  there  does  not  exist  a  general  result  that  proves  or  disproves  the  general 
case  where  T2  does  not  have  a  stable  inverse.  In  the  sequel,  a  smaller  lower  botmd  on 
||Ti  —  T2QT3II  is  furnished.  However,  it  is  not  evident  that  there  exists  a  causal  Q  that 
achieves  the  botmd. 


Theorem  4.2.3  Let  T3  =  I.  Then 


fJ'NL  > 


sup 


|rrin||i 

INIi 


Proof.  By  direct  computation,  with  u 


\\Ti-T2Q\\  >  \\{T^-T2Q)f\\oo  |i/|U<l 

>  ||u*(ri-T2Q)/|ioo  liu||i<l 

>  I|n_(u*(rx-T2g)/)|U 

=  ||n_(«*Ti/)|U, 

This  leads  to 


IIT1-T2QII  >  sup  sup  l|n_(u*Ti/)|| 

IH|i<1,u6ZV||/||oo<1 
=  sup  i|rr,u||i 


I 
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The  interpretation  of  this  bound  is  as  follows.  Fix  any  f  €  ioo{Z+),  then  there  exist 
a,  Q  f  such  that 

IKTi  -  T2Q/)/||oo  =  sup  ||n_u*Ti/||oo 

||ti||i<i,uew 

This  Q  f  however  may  very  well  be  a  non-causal  function  of  /,  and  hence  does  not  qualify 
as  a  candidate  solution  for  the  original  problem.  A  consequence  of  this  theorem  is  that 
in  the  case  of  a  fixed  input  minimization  [12],  nonlinear  time  varying  compensation  does 
not  improve  the  performance.  This  is  clear  from  the  fact  that  the  above  lower  bound  is 
valid  for  each  /  regardless  of  Q  and  can  be  achieved  with  Q  time-invEiriant  [12]. 

4.2.2  Linearization 


In  this  section,  we  show  that  the  use  smooth  NLTV  compensation  instead  of  LTI  com¬ 
pensation  does  not  improve  the  achievable  rejection  of  persistent  bounded  disturbances. 
The  systems  Ti,2,3  are  now  assumed  to  be  multi- input /multi-output. 

The  smoothness  condition  in  this  context  is  in  terms  of  the  compensation  being 
linearizable.  The  following  definition  is  adapted  from  [60,  Chapter  7]. 


Definition  4.2.1  An  operator  H  €  Mtv  is  linearizable  if  there  exists  an  linear  oper¬ 
ator  Hl  €  Ctv  so  that 


lim  sup 


ll/lloo 


In  this  case,  Hi  is  called  the  linearization  of  If. 


The  main  restdt  of  this  section  is  as  follows: 

Theorem  4.2.4  Let  /xjvi  he  defined  as  in  (4.1)  with  the  infiinization  being  over  all 
Q  G  Ntv  which  are  linearizable.  Then  pri  =  f-NL- 

Proof.  Let  Q  G  Afrv  be  linearizable,  and  let 

||Ti-T2gT3||  =  M- 

We  will  show  that  there  exists  a  Q  6  Cti  so  that 

||Ti  -  T2QT4  <  p. 
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The  idea  in  the  proof  of  Theorem  4.2.4  is  first  to  show  that  LTV  compensation  gives 
the  same  performance  as  linearizable  NLTV  compensation.  We  then  use  the  results  from 
[51]  to  show  that  LTI  compensation  gives  the  same  performance  as  linearizable  NLTV 
compensation. 

4.3  Concluding  Remarks 

Even  for  the  problem  of  disturbance  rejection,  nonlinear  controllers  can  offer  some  ad¬ 
vantage  as  seen  in  the  following  exeimple.  Let  z  denote  the  unit  delay  operator.  Let 
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Ts  =  I,  and  let 


Then  for  any  w  e  ioo, 


((Ti  -  T2Q)w){n)  =  U{n  -  1)  -  (Qti;)(n)  . 

\w{n-2)/  \iQw){n)/ 

Given  this  structure,  an  optimal  Q  may  be  constructed  as  follows.  Define 


■uj(n)  max(u;(n),  xv{n  —  1),  w{n  —  2)) , 
w{n)  ^  min  (i£7(n),  w{n  —  l),w{n—  2)). 

Then  set 

(QNL^Kn)  = - - - . 

It  can  be  shown  that  this  selection  of  Qnl  leads  to  j|Ti  -  T2Qnl\\  =  !•  This  choice  of 
Q  is  nonlinear.  However,  the  same  norm  can  be  achieved  by  using  the  linear  Q  —  Q. 
Nevertheless,  the  compensator  Qnl  achieves  tetter  performance  in  the  sense  that  signal- 
by-signal,  the  response  using  Qnl  is  smaller  than  using  C?  =  0.  That  the  two  choices 
lead  to  the  same  norm  means  there  exists  a  signal  so  that  the  responses  are  the  same 
size.  Note  that  the  choice  of  Qnl  is  not  differentiable.  Thus,  the  performance  is  not 
characterized  by  the  small  signal  behavior. 

A  comment  is  in  order  regarding  the  use  of  induced  norms  to  assess  the  performance 
of  nonlinear  feedback  systems.  For  linearizable  systems,  the  overall  performance  is  at 
best  the  “small-signal”  performance.  Thus,  it  seem  natural  that  linear  controllers  would 
perform  as  well  as  linearizable  nonlinear  controllers. 

It  turns  out  that  the  use  of  indticed  norms  to  assess  performance  may  be  too  restric¬ 
tive  in  the  presence  of  nonlinear  compensation.  The  reason  is  that  this  definition  requires 
the  ratio  of  the  error-norm  to  the  disturbance-norm  to  be  small  without  regard  to  the 
size  of  the  magnitude  of  the  disturbances.  More  precisely,  it  may  be  that  the  regulated 
variable  is  small  while  the  ratio  of  error-norm  to  disturbance-norm  is  large.  This  leads  to 
questioning  the  utility  of  induced  norms  to  quantify  performance  in  nonlinear  systems. 
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One  alternative  is  to  consider  the  worst  case  performance  over  a  given  class  of  dis¬ 
turbances.  For  example,  let  W  denote  some  bounded  set  of  disturbances.  Then  define 
the  performance  measure 

fj.^=  sup  ||T*u,tt)||. 

Such  a  performance  objective  is  partictdarly  well-suited  to  nonlinear  systems.  It  avoids 
using  induced  norms  and  addresses  directly  the  desired  goal  of  keeping  regulated  variables 
small.  Furthermore,  it  allows  the  class  of  disturbances  to  be  defined  as  desired.  For 
example,  one  may  define  W  as 

W  =  I  u;  6  ^co  :  ||tw||  <  ci  and  ^  N(n)|^  <  C2 

I  n 

This  definition  allows  both  a  magnitude  and  energy  bound  on  the  disturbances  of  interest. 
Such  notions  of  performance  have  been  considered  in  [48,  49]. 

Acknowledgments  The  authors  thank  Paul  Middleton  for  suggesting  the  preceding 
Qnl  example. 
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Chapter  5 

On  Slowly  Varying  Systems:  ioo 
to  loo  Performance  and 
Implications  to  Robust  Adaptive 
Control 


In  this  chapter  we  present  a  result  on  the  to  too  performance  of  slowly  time  varying 
systems.  In  particular  we  show  that  the  performance  of  such  systems  cannot  be  much 
worse  than  that  of  the  frozen-time  systems  which  are  time  invariant.  This  result  is  used 
to  characterize  a  class  of  indirect  adaptive  controllers  that  can  stabilize  a  time  invariant 
system  subjected  to  both  parametric  and  1^0  to  i^o  bounded  unstructured  uncertainty. 
Pertaining  to  this  class  of  controllers,  a  partictdcU"  r  indirect  adaptive  scheme  is  proposed 
that  provides  the  greatest  upper  bound  on  the  size  of  the  imstructured  uncertainty  for 
which  stability  is  ensured. 

5.1  Introduction 

The  problem  of  controlling  slowly  time- varying  systems  arises  in  many  applications.  The 
main  paradigm  is  in  gain-scheduling  where  the  plant  is  time-varying  emd  at  successive 
points  in  time  a  controller  is  designed  to  satisfy  certain  stability  and  performance  speci¬ 
fications  based  on  the  “frozen-time”  system  which  is  time  invariant  (LTI).  Therefore,  the 
resulting  controller  is  itself  time- varying.  However,  it  is  expected  that  if  the  rate  of  time 
variation  is  small  enough  then  the  frozen-time  properties  carry  on  to  the  overall  time- 
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varying  system.  In  other  words,  it  is  expected  that  the  stability  of  “frozen- time”  designs 
will  guarantee  stability  of  the  global  time- varying  system  and  also  that  the  performance 
of  the  global  system  cannot  be  considerably  worse  than  that  of  the  frozen  designs.  As  a 
matter  of  fact,  these  expectations  have  not  only  been  confirmed  in  practice  but  also  in 
theory  by  the  work  of  several  researchers  in  this  area  for  example  [6, 18,  27,  37,  50,  63,  64]. 

In  this  chapter  we  continue  the  work  of  [6]  that  was  centered  at  the  stability  issue 
and  extend  it  to  capture  the  performance  part  in  a  bounded  input  to  boimded  output 
{i.e.  too  to  ^oo)  sense.  We  use  the  input-output  framework  of  [6]  that  allows  infinite¬ 
dimensional  plants  and  controllers.  Hence,  the  need  of  a  fixed  degree  is  not  apparent. 
The  main  result  of  this  chapter  is  given  for  single-input  single-output  (SISO)  discrete 
slowly  varying  systems.  It  states  that  the  too  to  too  performance  of  the  global  time 
varying  system  cannot  be  much  worse  than  the  worst  frozen-time  too  to  too  performance 
given  that  the  rates  of  variation  of  the  plant  and  the  controller  are  sufficiently  small. 
Moreover,  given  the  continuity  properties  of  the  optimal  ii  design  established  in  [7]  it 
follows  that  optimed  ti  [10, 11]  frozen-time  design  yields  an  upper  bound  on  the  too  to  too 
p  performance  of  the  global  system.  Our  main  result  is  in  parallel  with  these  in  [63,  64] 
however  om  derivation  is  more  direct  and  smted  to  the  too  to  too  disturbance  rejection. 

An  important  application  of  our  main  result  is  in  robust  adaptive  control.  In  particu¬ 
lar  we  characterize  a  class  of  indirect  adaptive  controllers  that  can  stabilize  systems  that 
contain  both  parametric  and  unstructured  uncertainty.  The  unstructured  uncertainty 
enters  the  system  in  the  form  of  bounded-input,  bounded-output  operators  perturbing 
the  coprime  factors  of  the  plant.  This  class  of  stabilizing  controllers  is  obtained  by 
frozen-time  controllers  that  stabilize  the  estimated  models  at  each  time  of  the  plant. 
The  estimated  model  is  obtained  via  a  parsuneter  estimation  algorithm  which  produces 
slowly  varying  estimates.  The  conclusion  is  that  if  the  frozen  time  designs  stabilize  the 
estimated  model  together  with  the  unstructured  uncertainty  (possibly  after  some  initial 
transient  period)  then  stability  of  the  adaptive  scheme  is  guaranteed.  This  result  is  sim¬ 
ilar  to  the  one  reported  in  [41]  where  the  auhtors  use  a  continuous  time  framework  and 
a  different  characterization  of  the  size  of  the  uncertainty.  Finally,  among  this  class  of 
controllers  we  present  a  particular  adaptive  scheme  that  requires  for  stability  the  least 
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conservative  bound  on  the  (oo  to  i^o  “gain”  of  the  unstructured  perturbations.  This 
scheme  is  a  modification  of  the  £%  adaptive  scheme  foimd  in  [7]. 

5.2  Preliminary  Definitions 

In  this  chapter  the  following  notation  is  used: 

\x\2  :  The  Euclidian  norm  of  the  finite  dimensional  real  vector  x. 

W[A]  :  The  maximum  singular  value  of  the  matrix  A. 

^imxn  •  The  normed  linear  space  of  aU  m  x  n  matrices  H  each  of  whose  entries  is  a  right 
sided,  absolutely  summable  real  sequence  Hij  =  The  norm  is  defined  as: 

j=l  Jle=0 

:  The  normed  linear  space  of  aU  m,x  n  matrices  H  each  of  whose  entries  is  a  right 
sided,  magnitude  boimded  real  sequence  Hij  —  {Hij{k))^Q.  The  norm  is  defined  as: 

m 

^  \Hij{k)\) 

"*  Si  •'  ^ 

:  The  subspace  of  consisting  of  all  elements  which  converge  to  zero, 

f  “  :  The  space  of  real  m  x  1  vectors  u  each  of  whose  components  is  a  magnitude  bounded 
real  sequence  {u,(A:))^q.  The  norm  is  defined  as: 

||«||^«,  =  m^(sup 

m  , 

:  The  space  of  real  m  x  1  vector  valued  sequences. 

^(A)  :  The  A-transform  of  a  right  sided  m  x  n  real  sequence  H  =  {H{k))'^Q  defined  as: 

»(A)  =  f;  ir(fc)A‘ 

fe=0 


Amxn  :  The  real  normed  linear  space  of  aU  m  x  n  matrices  ^(A)  so  that  .H’(A)  is  the 
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A- transform  of  an  fimxn  sequence  Hi  This  space  is  isometrically  isomorphic  to 

:  The  space  of  all  linear  bounded  and  causal  maps  from  icon  ^oom-  We  refer  to 
these  operators'as  stable. 

:  The  subspace  of  consisting  of  the  maps  that  commute  with  the  shift 

operator  (i.e.  the  time  invariant  maps).  This  space  is  isometrically  isomorphic  to  Amxn- 
:  The  fc‘^-truncation  operator  on  defined  as: 

MO), «(!),...}  — >  M0),---,u(A:),0,0,...} 

Am  :  The  right  shift  operator  on  i.e. 

Am  :  {a(0),a(l),...}  — ^  {0,a(0),a(l), . . .} 


Note;  We  will  often  drop  the  m  and  n  in  the  above  notation  when  the  dimension  is 
not  important  or  when  it  is  clear  from  the  context.  Also,  subscripts  on  the  norms  are 
dropped  when  there  is  no  ambiguity. 


Let  r  be  an  operator  in  Cti  with  transform  representation 

T'(A)  =  f;r(.-)A‘. 

t=0 

Definition  5.2.1  The  Integral  Time  Absolute  Error  ITAE  associated  with  T  is  defined 
as 

OO 

ITAE{T)  =  Y,  *|T(ife)|. 
k=o 

If  T'  is  the  LTI  operator  associated  with  the  derivative  r'(A)  =  then  it  follows  that 

ITAE(T')  =  ||T'||. 

Given  a  sequence  of  LTI  operators  {At}^o  where  each  At  is  a  map  from  f**’®  to  we 
can  generate  a  time  varying  operator  A  as  (Ay)(f)  =  {Aty){t),  t  =  0, 1, . . .  . 
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Definition  5.2.2  The  operator  A  is  called  slowly  time-varying  if  there  is  a  constant 
7  >  0  so  that 

||^-^^!|  <  7|t-r|  Vt,r. 

This  is  denoted  by  At  €  STV{‘y). 

If  At  E  Uti  for  all  t  and  also  the  Cji  norm  is  bounded  uniformly  in  t  then  A  6  Ctv  and 
norm  A  =  supj  ||Pi^j4t||. 

5.3  Problem  Definition 


The  problem  we  want  to  analyze  is  the  stability  and  performance  of  the  feedback  system 
in  Figure  5.1  where  P  is  a  slowly  varying  plant  and  C  is  a  controEer  obtained  by  “frozen¬ 
time”  control.  SpecificaUy,  the  plant  P  is  defined  as  P  =  A-^B  where  A,B  are  slowly 
varying  operators  associated  with  the  sequences  {Aj},  {Pj},  t  =  0, 1, 2, ...  of  LTI  stable 
operators  respectively  and  with  A~^  being  well  defined.  Hence,  the  plant  model  is 


yit)  =  (Bu)(t)  =  (A  ^Bu)(t),  t  =  0, 1, 2, . . . 

or,  eqmvalently, 

(.4tj/)(t)  =  (Ptu)(t),  f  =  0,1,2,.... 

We  refer  to  the  LTI  system  Pt  =  A^^Bt  as  the  “frozen-time”  plant.  The  controEer  is  given 
as  C  =  where  L,  M  are  associated  with  the  sequences  {Lt},  {Mt},  t  =  0, 1, 2, ...  of 

LTI  stable  operators  i.e.,  {Ly){t)  =  {Lty){t)  and  {My){t)  -  {Mty){t).  Moreover,  Lt,Mt 
are  so  that  the  LTI  controEer  defined  as  Ct  =  L^^Mt  stabiEzes  the  frozen  time  plant  Pf 
The  controEer  operates  as 


{Cy){t)  =  {L-^My){t),  t  =  0,1,2,... 

or,  equivalently, 

{Ltu){t)  =  {Mty)it),  t  =  0,l,2,.... 

The  question  we  want  to  answer  is  under  what  conditions  the  feedback  loop  is  stable 
and,  if  so,  what  is  the  relation  between  the  performance  of  the  frozen-time  pair  {Pt,Ct) 
and  the  actual  time  varying  feedback  pair  (P,  C).  This  is  done  in  the  foUowing  section. 
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2/2 

2/3 

U2 

O  1 

FigTxre  5.1:  Feedback  Loop  of  the  Pair  (P,  C) 

5.4  Main  Result 

In  [6]  an  input-output  point  of  view  was  taken  to  prove  that,  under  the  assxxmption 
of  sufficiently  small  rate  of  variation,  stability  of  the  frozen- time  feedback  pair  {Pi,  Ct) 
implies  stability  of  the  pair  {P,C).  Yet,  the  performance  part  of  the  problem  was  not 
investigated.  In  the  sequel  we  take  the  same  point  of  view  as  in  [6]  and  extend  the  results 
in  [6]  to  capture  the  performance  issue.  In  particular,  for  the  system  in  Figure  5.1  define 
the  stable  LTI  operator  for  each  t  =  0, 1,  2, . . . 

Gt  =  LiAt  +  MiBi- 

Since  Ct  stabilizes  Pt  then  Ht  =  Gf  ^  G  Cti-  Now  let  5*-’  represent  the  map  from  Uj  to 
xji  in  the  system  of  Figure  5.1  and  the  (LTI)  map  from  Uj  to  yi  for  the  frozen  system 
(Pt,  Gt).  The  following  theorem  which  is  an  extension  of  Theorem  1  in  [6]  supplies  the 
answer  to  our  problem. 

Theorem  5.4.1  Assume  the  following: 
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1.  The  operators  defining  the  plant  P  are  slowly  time-varying  with  rates  i-e., 

AteSTV(jA),BteSTV(jB)- 

2.  The  operators  defining  the  controller  C  are  slowly  time-varying  with  rates  7l,jm 
i.e.,  Lt  e  STy(7£),Mt  €  STV{^m)- 

3.  The  Cti  norms  and  the  ITAE  of  the  operators  At,  Bt,  Lt,  Mt  are  uniformly  bounded 
in  t;  this  of  course  means  that  A,  B,  L,  M,  G  Cyv 

4.  The  Cti  norms  and  the  ITAE  of  the  operator  Ht  =  are  uniformly  bounded  in 
t. 


Then,  for  a  given  e  >  0,  there  exists  a  nonzero  constant  7  so  that,  if  <  1, 

the  closed  loop  system  is  internally  stable  and 

(l-e)||5‘^||<sup||5‘i  +  e. 

t 

Proof.  The  proof  of  the  stability  part  is  given  in  [6].  Here  we  repeat  in  brief  the  mmn 
steps  because  we  will  use  them  to  prove  the  claim  for  the  performance.  The  closed  loop 
equations  for  the  system  in  Figure  5.1  are  as  follows: 

(^t/i)(t)  =  {Bt{ui  -  y2)){t) 


{Liy2){t)  =  {Mt{u2  +  yi)){t) 

AtLt  4"  MtBt  —  Gt 

By  adding  subtracting  and  grouping  terms  we  finally  arrive  [6]  at 

(G  +  X  Y  /TH  -BM\(u^\ 

V  -Z  G  +  W)\y2)  \MB  AMJ\u2J 


(CL) 


where  G  is  the  operator  in  Cyv  associated  with  the  family  {Gt}  and  X,Y,Z,W  are 
“perturbation”  operators  which  are  due  to  the  time  variation  of  the  system  P.  As 
indicated  in  lemmas  1  and  2  in  [6]  these  operators  have  Ctv  norm  bounded  by  the  term 
yxconstant  where  7  =  max(7j4, 7J5, 7l, 7Af)  and  the  constant  depends  on  the  uniform 
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bounds  of  assumption  3  of  the  Theorem  5.4.1;  i.e.,  there  are  constants  cx,  cy,  cy^cw  >  0 
so  that 

Jl.X'll  <  7CX,  ||y||  <  7cy,  ||2^||  <  7Cy,  \\W\\  <  jcw 
Now,  from  the  first  equation  in  (CL)  we  have 

Gyi  +  Xyi  4-  Yy2  =  v 

where  v  =  LBui  —  BMu2.  If  we  fix  some  t,  Gt  is  a  LTI  operator;  adding  and  subtracting 
this  operator  in  the  above  operator  equation  we  obtain 

Gtyi  +  (G  —  Gt)yi  +  Xy\  +  Yy2  =  v 

or  since  =  Gf^  we  obtain 

yi  +  Ht{G  -  Gt)yi  +  HtXyi  +  HtYy2  =  Htv. 

Evaluating  this  operator  equation  at  time  t  we  obtain 

yi(t)  +  {Ht{G  -  Gt)yi){t)  +  {HtXyi){t)  +  {HtYy2){t)  = 

Define  the  operator  H  as  {Hz){t)  —  {Hrz){T)^  r  =  0,1,2, ....  Also  define  the  operator 
R  as  (^t/i)(r)  =  {Hr{G  -  Gr)yi)(T),  r  =  0,1,2,....  Rewritting  the  above  equation  in 
operator  form  we  have 


yx  +  Ryx  +  HXyx  +  HYy2  =  Hv. 


Similarly  working  with  the  second  equation,  letting  w  =  MBui  +  AMu2  and  putting 
both  equations  together  in  operator  form  we  get 


where 

(R-^HX  HY  \ 

V  -HZ  R  +  HW)' 

Note  that  from  the  uniform  boimd  assumption  on  it  follows  that  H  G  Cyv  and 
therefore  the  norms  of  the  operators  HX,H Z,HY,HW  can  be  bounded  by  7  x  constant. 
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Also,  utilizing  the  fact  that  the  ITAE  of  Hr  is  uniformly  botmded  it  is  shown  in  [6]  that 
the  norm  of  R  is  botmded  in  the  ssime  way  i.e.,  |li2||  <  7Xconstant.  The  stability  of  the 
loop  then,  follows  from  the  small  gain  theorem  for  sufficiently  smsdl  7. 

We  now  come  to  the  performance  part.  We  will  prove  our  claim  for  the  maps  5^®,  5^^; 
the  proof  for  any  other  map  is  completely  analogous.  Let  ui  =  0  and  let  ||u2||  <  1.  Then 
from  the  system  equations  we  get 

t/i(t)  =  -  iHtXyi){t)  -  {HtYy^m  -  {H,iG  -  G^it) 

Consider  now  the  frozen  LTI  feedback  system  at  time  t  i.e.,  (Pj,  Ct)  subjected  to  the 
same  input  U2  and  let  yu  denote  the  output  that  corresponds  to  yi  in  the  time  varying 
loop  (P,  (7).  Then  evaluating  yn  at  t  we  have 

yu{t)  =  -{HtBtMtU2){t). 

Subtracting  the  above  two  equations  we  obtain 

yit{t)  -  yi{t)  =  (HtiBM  -  BtMt)u2){t)  +  [HtXy^m  +  {HtYy^m  +  {Ht{G  -  Gt)yx){t). 

The  idea  here  is  to  bound  \{Ht{BM  —  BtMt)u2){t)\  by  7Xconstant.  For  this  purpose 
define  the  operator  K  6  Ctv  as 

{Kz){t)  =  {BrMrZ){T)  T  =  0,1,2,... 


then 


{Ht{BM  -  BtMt)u2)it)  =  {HtiBM  -  K)u2){t)  +  {Ht{K  -  BtMt)u2)it). 

By  lemma  1  in  [6]  and  the  fact  that  Ht  has  norm  uniformly  bounded  it  follows  that 

\{Ht{BM  -  K)u2){t)\  <  7ci 

with  Cl  a  positive  constant.  For  the  term  {Ht{K  -  BtMi)u2){t)  we  have  the  following: 

IIP.M.  -  PtMill  <  ||P,||||M,-Mt||  +  ||Mt||||Pt-P.|| 

<  ||Pr||7M|t -t|  +  ||Mt||7B|t  -  r| 
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<  7^21^  -  T"!- 

Hence,  if  z{t)  =  {{K  -  HfMt)u2)(r),  then  |2(r)|  <  7C2|t  -  r|,  r  =  0,1,2,...  with 
C2  >  0.  But  then  from  the  fact  that  Ht  has  bounded  (uniformly  in  t)  ITAE  it  follows  as 
in  theorem  1  of  [6]  that 

\iHt{K  -  BtMt)u2m\  = 

r=0 

<  JC2^\ht{T)\T 

T=0 

<  7^3,  C3  >  0. 

Now,  looking  at  the  rest  of  the  terms  and  since  ||u2||  <  1  we  have  KHtJf yi)(t)|  < 
7C4||5^2|1,  |(Htyy2)(0l  <  7C5||5“||  and  ]{Ht{G  -  C?t)j/i)(t)|  <  7C6||5^2||  gp  pitting  ev¬ 
erything  together  it  follows  that  there  are  c,  ci2,C22  >  0  so  that 

lyiiO  -  <  7C  +  7C12||-S'^^||  +  7C22il-S'”|i 

or  since  ||u2||  <  1  then  |yij(t)|  <  and  therefore 

sup  |yi{t)|  <  sup  ||5/2||  +  7c  -t-  7Ci2||5^2||  +  7C22||5'22|| 

t  t 

and  since  U2  is  arbitrary 

115^*11  <  sup  ||5t^2||  +  -yc  -i-  7Ci2||5^2||  +  7C22||'5®^||- 
{ 

Similarly  working  for  ||5^^||  we  get 

||522||  <  sup  II5PII  4-  7fc  +  7k22\\S^^  +  7fei2||5i==|i. 

t 

Now  noting  that  IjiftH  is  rmiformly  bounded  then  sup^  ||5t^l|,supt  l|5t®||  <  oo  and  hence 
by  assumming  7  sufficiently  small  the  proof  of  the  theorem  is  complete.  I 

The  above  theorem,  roughly  speaking,  indicates  that  if  the  rates  of  variation  of  the 
plant  and  the  controller  are  sufficiently  small  then  frozen  time  control  would  not  only 
provide  stability  but  also  the  resulting  performance  cannot  be  much  worse  than  the 
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worst  frozen  time  design.  In  [7]  it  was  shown  under  certain  assumptions  of  existence  eind 
uniqueness  that  the  t\  design  methodology  produces  optimal  frozen-time  LTI  controllers 
for  the  frozen-time  plant  that  possess  the  slow  variation  property  given  that  the  plant 
is  slowly  varying.  Hence  an  upper  bound  on  the  achievable  ||5’'^|(  can  be  obtained  by 
considering  ^i-optimal  [10, 11]  frozen  time  control i.e.,  by  considering  supj  ||5J''||  obtained 
by  optimrd  designs. 

Remark 

A  natural  question  that  arises  in  the  case  where  the  plant  P  is  slowly  time  varying  is 
whether  optimal  frozen- time  design  at  each  time  t  will  result  in  an  optimrd  or  near- 
optimal  design  (depending  on  the  rate  of  variation)  for  the  time-veirying  system.  Al¬ 
though  it  is  tempting  to  conjecture  that,  if  the  rate  of  variation  is  sufficiently  small  then 
the  optimal  performance  cannot  be  far  from  the  performance  provided  by  optimal  frozen¬ 
time  control  at  each  time  t,  the  following  example  shows  that  this  might  not  be  true: 
Consider  the  plant  P  £  £tv  defined  by  the  sequences  where  At(A)  =  iVt, 

Ht(A)  =  2A  -f-  1  for  t  =  0, 1  and  Bt{X)  =  2A  4-  (14-  yt)  for  2  <  t  <  T  =  [I/7  +  1], 
J5((A)  =  2A  4-  (1  4-  7T)  for  t  >  T,  with  7  >  0.  The  resulting  Toeplitz  representation  of  P 


2  14-7 

2  1  +  27 

2  l4-r7 

2  1  4-T7 


Clearly,  for  this  P  we  have  \\Bt  —  Hr|l  <  7|t  —  r|  Vt,  r.  Suppose  we  eire  interested  in 
minimizing  the  £tv  norm  of  the  sensitivity  map  5  =  (1  4-  PC)~^ .  Then  as  it  is  well 
known  [19,  57,  61]  the  optimization  problem  transforms  to 


inf  lll-i’QII- 

q<z£tv 
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For  this  pMticuleir  P  we  have  that  P~^  6  jCtv  since  Pt  =  Bt  is  eventually  {t  >  T)  stably 
invertible.  To  view  this,  let  P~^  be  represented  by  the  lower  diagonal  structure 

/?(0,0)  0  ...\ 

=  g(l,0)  g(l,l)  ...  . 

Then  the  following  recursion  holds: 

q{hj)=  l,j),  i  >  0,  j  =  0, 1 

with  q{Q,  0)  =  1,  q{i,  i)  =  1/(1  +  {i  -  1)7)  for  i  =  1, . . . ,  T  and  q{i,  i)  =  1/(1  +  T'f)  for 

i  >  T.  Note  that  for  i  >  T  we  have  that  |g(j,  i)|  =  |g(T,  T)|  <  1.  Therefore,  for  any 

A:  =  1, 2, ...  we  have 
T+k 

E  WIT  + j)|  <  l9(r  - 1, J)l)l9(r,  r)|*  +  mt,  T}\i 

<9.l9(r.T)|  +  Tn;^- 

This  evidently  shows  that  P~^  G  Ctv-  Hence,  by  choosing  Qo  =  P~^  we  can  make 
II 1  —  PQoW  =  0  for  any  7.  On  the  other  hand,  using  optimal  frozen  time  design 
yields  [10,  11]  5t=o  =  Ij-ytr:!  =  l)-*-»5't=r  =  05‘5't=r+i  =  0i —  The  reason  for 
St=o,  • .  •  StzzT-i  0  is  of  course  the  unstable  zero  of  Pt=Q, . . . ,  Pt=T  at  A  =  (1  +  <7)/2 
for  aU  7.  Moreover,  the  resxilting  frozen  time  based  controller  will  yield  a  performance 
||5||  >  1  for  any  7  >  0  no  matter  how  small,  since  the  system  will  behave  exactly  as  the 
frozen  LTI  one  for  t  =  0, 1. 

5.5  Application  to  Robust  Adaptive  Control 

In  this  section  we  utilize  the  main  residt  of  the  previous  section  in  order  to  design  a  con¬ 
troller  for  a  LTI  system  which  contains  both  parametric  (structured)  and  unstructured 
uncertainty. 

5.5.1  Problem  statement 

The  problem  we  want  to  resolve  is  as  follows: 

We  are  given  the  single- input,  single-output  discrete  system 

((^„  -f  AA)y)(t)  =  {{Bo  +  As)u)(t)  4-  d{t) 
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where  Ao,Bo  are  operators  in  Cti  with  a  polynomial  A-transform  representation 

=  1  +  flo(l)A  +  Oo(2)A®  +  •  •  •  +  ) 

J9,(A)  =  6<,(1)A  +  hi2)X^  +  . . .  +  6„(m2)A™S 

with  the  coefficients  of  ^<,(A)  and  Bo{X)  not  known  a  priori;  and  Ab  are  unknown, 
possibly  time-varying,  operators  in  Ctv  i-e.,  ||Aji||,  HAbU  <  oo;  finally,  d  is  a  botmded 
disturbance  i.e.,  |d(t)|  <  £>,  Vt  =  0, 1, 2, . . .  for  some  D  >  0.  We  assume  the  following  a 
priori  knowledge 

Assumption  5.5.1  The  integer  n  =  max(mi,m2)  is  known. 

Assumption  5.5.2  The  coeiScients  of  Ao(A),  Bo{X)  lie  in  a  compact  convex  set  0  which 
is  known.  Moreover,  the  above  polynomials  are  coprime  (no  conunon  zeros)  for  all 
possible  values  of  their  coefficients. 

Assumption  5.6.3  The  bound  D  and  some  bound  so  that  ||(Ab  Ayi)||  <  are 
known. 

Our  task  is  to  find  a  controller  C  that  stabilizes  the  system  in  the  presence  of  the  bounded 
disturbance  d.  The  situation  is  depicted  in  Figure  5.2  where  =  A~^Bo. 

5.5.2  An  Indirect  Control  Scheme 

The  system  equations  can  be  rewritten  as 

y{t)  =  <t>{t  -  ife,  -F  d{t)  -f  ((As  A^)  (“)  )(t) 

where 

Oo  =  (-ao(l)...-ac(n)  6o(l) . .  .6o(n))^ 

^(t  -  1)^  =  {y{t  -  1) .  ..y{t  -  n)  u{t  -l)...u{t-  n)). 

The  approach  we  will  use  to  design  the  controller  is  an  indirect  adaptive  scheme 
[30]  which  is  a  generalization  of  the  one  in  [7]  to  include  unstructured  imcertainty.  In 
particular,  we  will  use  a  parameter  estimation  scheme  to  supply  at  each  time  t  estimates 
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Figure  5.2:  The  Feedback  Loop  of  (P<„  C)  with  Unstructured  Uncertainty 
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9t  for  9o.  The  controller  C  will  be  designed  based  oil  frozen  designs  Ct  so  that  C*  stabilizes 
the  estimated  system  at  time  t;  the  properties  of  slow  variation  of  the  estimates  produced 
by  the  parameter^estimation  scheme  together  with  the  main  result  of  the  previous  section 
will  guarantee  stability. 

More  specificciUy,  let  6{t)  =  ((Ab  A^i)  equation  for  the  model  is 

y{t)  =  <f>{t-lf9o  +  d{t)  +  S{t) 


with  |^(t)|  <  D^{t)  and  |ci(t)|  <  I?,  Vt  =  0, 1, 2, . . .  where 

D^{t)  =  Da  m^^(|«(r)|,|y(r)|). 

The  parameter  estimation  scheme  to  be  used  is  a  robustified  least  squares  algorithm 
with  dead-zone  found  in  [42]  which  is  a  modification  of  the  one  in  [29].  Define  for  each 
estimate  9t  the  error  signal 


then  the  algorithm  is  as  follows 


dt  =  + 


v(f)P(t  —  2)^(t  —  1) 

l)rp(t  -  2)4>{t  -  1) 


e{t) 


with 


P(t  -  1)  =  P(t  -  2) - 


v{t)P{t  -  2)<^(t  -  -  lfP{t  -  2) 


1  +  <^(t  -  l)Tp{t  -  2)4>{t  -  1) 
where  and  P(-l)  are  initial  guesses  with  P(-l)  =  P(— 1)^  >  0,  and  where  u(t)  = 
as(t)  with 


where  we  choose  a  €  (0, 1),  /3  is  defined  by  /3  =  y^l/(l  —  a)  and  /(•,  •)  is  the  dead-zone 
function 


f{x,y) 


|2/|-|z|,  if|a:|<|j/| 

0,  otherwise 


The  fuU  set  of  details  of  the  algorithm  can  be  found  in  [42].  The  properties  of  the 
algorithm  that  will  be  used  for  stability  of  the  adaptive  scheme  are 
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1. 


2. 


P{^{D\t)  +  D)Mm  0 

t_oo  1  4-  -  l)P{t  -  2)4>{t  -  1) 


lim  \et  -  =  0 

£—♦00 


3. 


P{t)  >  0,  a[P{t)]  <  o'fPl-l)]  <  oo,  'it 


We  should  note  that  constraining  the  estimates  $t  to  lie  in  0  as  in  [30]  does  not  change 
properties  1,2,3  of  the  algorithm.  The  parameter  j3  in  the  estimation  scheme  will  be 
taken  close  to  1  i.e.,  1  <  /3  <  1  +  /;,  where  t;  is  sufficiently  small  (to  be  established  in 
the  sequel)  and  positive.  The  following  generalized  “key  technical  lemma”  [7,  30]  gives 
conditions  for  stability  of  the  adaptive  scheme. 


Lemma  5.5.1  Assume  the  following 

1.  there  are  constants  Cj  >  0,  C2  >  0  and  some  time  instant  T\  so  that  for  all  t  >T\ 


|<^(0l2  <  Cl  +  C2  max  |e(t)|. 


2. 


lim 


+  D)Ae{t)\) 


=  0, 


t_oo  1  +  _  2)4,{t  -  1) 

3.  there  are  constants  ki  >  0,  k2  >  0  with  ^2  <  ^  and  some  time  T2  so  that  for  all 
t  >  T2 

D^{t)  <  ki  +  k2  max  |e(T)|. 

“  T2<T<t 

Then  the  sequence  {e(t)}  is  bounded  and,  therefore,  {^^(<)}  are  bounded. 

Proof.  Assume  {e(t)}  is  unboimded  and  let  the  subsequence  {e(t„)}  be  so  that  lim„_oo  \e{tn 
00  with  ie(to)|  <  |c(fi)|  <  . . ..  Then  there  is  some  no  so  that  in  >  no 
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|'?!'(<n)i2  <  Cl  +  C2\e{tn)\ 

/(/3(Z?i(i„)  +  £>),  e(«„))  =  |e(f„)i  -  +  £>)  >  0. 


But  then  if 

„  PmD\t^)  +  D)Mtn)\) 

”  1  +  -  l)P(t„  -  2)<f>{tn  -  1) 


we  have 


therefore 


,  ^  {\e{tn)\-^{D\U)  +  D)f 
l  +  |^(t„-l)|2^{F(-l)] 


limsupan  > 

n— *cc 


(1-;9^2) 

cp[P{-^)] 


which  contradicts  assumption  2. 


I 


The  above  lemma  guarantees  boundedness  of  the  signals  provided  that  the  three  as¬ 
sumptions  hold.  Hence,  if  the  control  signal  u  is  such  that  the  assumptions  of  Lemma 
5.5.1  are  satisfied,  then  the  above  weak  form  of  stability  [7]  of  the  system  is  obtained. 

In  the  sequel  we  show  that  under  certain  conditions,  using  frozen  time  control  for  the 
estimated  system  at  each  time  t  generates  a  control  sequence  u  that  satisfies  the  assump¬ 
tions  of  Lemma  5.5.1  and  hence  weak- stability  is  guaranteed.  This  is  done  as  follows: 

Rewriting  the  equation  for  the  error  e  we  obtain 

{At-iy){t)  =  4-  e{t) 

where  j4t_i,  Pt_i  G  £r/ are  defined  by  the  estimate 04_i  =  (— at_i(l) . . .— at_i(n)  6t_i(l) . . .  6t-i(n))^ 
as 

j4t_i(A)  =  1-1-  at_i(l)A  -f-  at-i(2)A^  4-  • . .  ut-i(n)A", 

-Ht_i(A)  =  6t_i(l)A  +  5t_i(2)A^  -f  . . .  4-  5t_i(n)A”. 

Therefore,  u  and  y  can  be  considered  as  the  input  and  output  of  a  “fictitious”  time- 
varying  system  defined  above  (Figure  5.3)  subjected  to  the  disturbance  e.  Suppose 
now  that  the  controller  C  provides  stability  for  the  fictitious  system  and  also  has  the 
property  i|5“®||,  ||5^®||  <  1/(Da(1  4-^))  where  and  5^®  are  the  maps  from  e  to  u  and 
y  respectively  and  77  >  0  with  1  <  /3  <  1  4-  t?.  Then,  the  assumptions  of  Lemma  5.5.1  are 
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Figure  5.3:  The  “Fictitious”  Feedback  Loop 

satisfied:  the  validity  of  assumption  1  follows  from  the  stability  of  the  fictitious  system, 
assumption  2  is  satisfied  from  the  properties  of  the  parameter  estimation  algorithm  and, 
finally,  assumption  3  is  fulfilled  since 

D^{t)  =  Da  max  (iu(r)|,|y(r)|)  <  Da  max(||5“*||,  ||5s''|i)  ma^  |e(r)| 

0<T<{ 

or 

D^{t)  <  k2  i«(7')l)  ^2  =  1/(1  +  ??)  <  l/yS. 

In  fact,  we  can  relax  the  norm  requirements  ||5“''||,  |15*'*||  <  1/(Da(1  +  q))  on  the  maps 
^ye,  gue  |jy  imposing  the  same  condition  for  a  delayed  version  of  the  fictitious  system. 
To  view  this,  suppose  the  controller  is  defined  by  LTI  stable  operators  as 

(ltu)(t)  =  (Mty)(t)  +  r(t) 

where  £({A),Mt(A)  are  coprime  polynomials  of  degree  at  most  N  for  all  t.  Without  loss 
of  generality  we  can  take  N  >  n.  Let  A  be  the  right  shift  operator  and  assume  that 
there  is  a  time  index  T  so  that  the  delayed  maps  A“^5“®A^,  A~^5*'®A^,  A~^5“’’A^, 
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A~^S^A'^  are  in  Ctv  i-e*?  if  the  inputs  e,r  £  loo  are  delayed  by  T  then  the  resulting 
y,  u  are  in  loo-  Moreover,  let 

^  ||A-2'5-A^||,  IIA-r^y^Aril  <  i/(z?^(i  +  rj)). 

Defining  the  state  vector 

=  iy{t  -  “(t  -  iV)  y(t  -  iV  +  1)  u(t  -  iV  +  1)  ...  y{t  -  1)  u{t  -  1))^ 

we  obtain  the  state  space  description 


0 

I  0 

0  / 

0  \ 
0 

0 

x{t)  + 

(Q\ 

0 

0 

Ui(t) 

0 

$2(t)  ... 

0  I 

[ij 

where  ^i{t)  are  2x2  matrices  obtained  from  the  coefficients  of  .4t{A),  jBt(A),  it(A),  Mt(A) 
and  w{t)  =  (e(t)  r(t))^.  Clearly,  this  is  a  completely  reachable  state  space  represen¬ 
tation  of  the  closed  loop.  Therefore,  we  can  ensure  that  the  initiad  input  {e(t)}^o 
does  not  produce  unbounded  u  and/or  y  for,  otherwise,  it  contradicts  the  stability  of 
the  delayed  system:  any  state  at  T  -f  iV  is  reachable  by  some  w  £  loo  of  the  form 
to  =  {0, . . . ,  0,  «?(T),  w{T  4- 1), ... ,  w{T  -i-  N),  0, . . .}  and  a  zero  state  at  T;  hence  the  ini¬ 
tial  input  {e(t)}^o  cannot  drive  the  system  to  a  state  at  T-f-iV  that  results  to  unbounded 
a;(t),  t  >  T  because  then  a  bounded  w  as  above  applied  to  the  delayed  system  would  yield 
an  unboimded  y  and  u  which  is  a  contradiction.  But  then  we  can  pick  some  nonzero  ci ,  ki 
to  account  for  the  initial  input  {e(t)}^o  and  have  the  conditions  of  Lemma  5.5.1  sat¬ 
isfied  for  Ti  =  Tj  =  T.  This  in  turn  will  guarantee  weak  stability  of  the  adaptive  scheme. 


5.5.3  A  Class  of  Stabilizing  Controllers 

Property  2  of  the  estimation  algorithm  shows  that  the  parameter  estimates  will  eventu¬ 
ally  vary  arbitrarily  slowly;  hence  since  \\Ai  -  <  \0t  -  and 

\\Bt  -  it  follows  that  eventually  At^Bt  €  STV{‘y)  for  some  7  >  0 

arbitrarily  small.  Utilizing  now  the  results  of  Theorem  5.4.1  and  Lemma  5.5.1  we  are 
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able  to  characterize  a  class  of  stabilizing  controllers  for  the  original  system  of  Figure  5.2. 
This  is  done  in  the  following  theorem. 

Theorem  5.5.1  Assume  that  for  each  t  the  frozen  time  controller  Ct  =  sta¬ 

bilizes  the  frozen  time  LTI  system  given  by  At-iy  =  Bt.iu  +  e.  Also  let  the  following 
be  true 

1.  There  are  constants  cjvf,  cl  >  0  so  that 

\\Mt  -  <  CM\0t  -  \\Lt  -  Lt-i\\  <  ci,\dt  - 

2.  The  degrees  of  Lt{^),  Mt{^)  3s  well  as  the  ITAE  of  Mt,  Lt  are  uniformly  bounded 
in  t. 

3.  The  Cti  norm  and  the  ITAE  of  Ht  =  {LtAt  +  are  uniformly  bounded  in 

t. 


4.  There  is  a  e  >  0  and  a  time  index  To  >  0  so  that 

1  —  e 


where  Sr  =  Sr  =  Lt-iHt-i. 

Then  the  control  law  u(t)  =  where  (Lt-iu)(t)  =  (Mt-iy){t),  t  =  0,l,...  yields 

a  weakly  stable  adaptive  system. 


sr 


< 


Proof.  The  proof  of  the  theorem  follows  the  same  steps  as  Theorem  5.4.1.  First,  since 
the  estimates  shoiild  lie  in  the  compact  set  0  and  At(A),  Bt{X)  have  degree  n  then  A^  Bt 
have  uniformly  bounded  norms  and  ITAE  [7].  Also,  from  assumption  1  the  Cti  norms 
of  Mt,Lt  will  be  uniformly  bounded.  Note  that  Sr  =  Mt-iHt-i,  Sf  =  are 

precisely  the  maps  from  e  to  u  and  from  e  to  y  respectively  in  the  frozen  LTI  system. 
Since  the  rate  of  variation  of  the  estimates  converges  to  zero  then  there  exists  some  time 
index  T  >  To  after  which  the  rate  of  variation  is  sufficiently  small  to  guarantee  stability 
of  the  delayed  fictitious  system  and,  moreover,  the  delayed  performance  conditions 


(1  —  e)(|A  ^5“®A^||  <  sup  ||5“'||  +  e 

t>T 


83 


and 


(l-€)||A-^5!^'Al<sup||5ril+e. 

t>T 

The  above  assertion  can  be  proved  exactly  as  in  Theorem  5.4.1.  But  then 

||A-^5«‘A2’||  <  1/(£>^{1  +  T?)),  ilA-r^-A^II  <  l/(i?A(l  +  rj)) 

and  hence  by  the  key  technical  Lemma  5.5.1  the  proof  is  complete.  I 

Note  that  the  requirements  on  the  frozen-time  LTI  maps  5"®  =  Mt-iHt-i,  = 
Lt-xHt-i  are  exactly  the  stability- robustness  requirements  in  the  presence  of  the  co¬ 
prime  factor  perturbations  A^,  Aa  of  “almost”  the  same  magnitude  (for  small  enough 
q,  e)  in  the  estimated  LTI  system.  Hence  the  meaning  of  the  above  theorem  is  the 
following:  Given  a  design  methodology  that  produces  controllers  Ct  which  are  Lipschitz- 
continuous  with  respect  to  the  parameter  estimate  0t,  then  stability  of  the  frozen-time 
feedback  loop  of  {At-\  -f  Ax)~^(J?t_i  -f  Aa)  and  Ct  will  result  to  weak  stability  of  the 
adaptive  scheme.  Next,  we  present  an  indirect  adaptive  scheme  which  produces  frozen- 
time  controllers  that  possess  the  required  continuity  properties. 


5.5.4  The  lx  Adaptive  Algorithm 


Here  we  present  briefly  a  genereilization  of  the  lx  adaptive  scheme  of  [7]  and  give  sufficient 
conditions  for  stability.  The  scheme  utilizes  frozen-time  controllers  Ct+x  =  at 

each  t  -t- 1  that  stabilize  Pt  =  A^^Bt  and  minimize  the  following  criterion 


inf  I 

Ct+1  stabilizing 


cue 

1 II  = 

eye 


inf  I 

stabilizing 


Ct+xAT^{l  +  PtCt+x)-^ 
At  ^(1  -f  PtCi+x)~^ 


Employing  the  parameterization  of  aU  stabilizing  controllers  [28]  for  Pt  we  transform  the 
problem  to 


H{9t)  =  iirf| 


+ 


At 


Qt 


Q.  "  \XtJ  '  \Bt, 

where  Xt,  Yt  are  polynomials  in  Cti  satisfying  the  Bezout  identity 


XtAt  -  YtBt  =  1. 
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All  stabilizing  controllers  are  obtained  as 


C't+i  — 


Yt  +  AiQt 


+  BtQt 

Since  At,  Bt  are  coprime  then  the  only  restriction  on  Kt  —  ^  Qt  is 

{-Bt  At)Kt  =  0 

which  implies  that  the  only  interpolation  [5]  on  the  closed  loop  ^  j  is 

{-Bt  = 


sr 
'! 
t+1 


As  indicated  in  [5]  the  problem  can  be  transformed  to  a  semiinlinite  linear  programming 
problem  using  duality.  The  solution  to  the  latter  can  then  be  computed  with  arbitr^lry 
accuracy  by  trtmcating  the  constraints  or  the  variables.  In  particular,  the  resulting 
problem  is  as  follows  [5] 

lj,{$t)  =  sup  iB(0) 

ir6c® 


subject  to 


-Ml)  ... 

-bt{n) 

0 

0  ...\ 

0 

-6e{0)  -6t(l) 

-h(Ti) 

0  ... 

II 

at(0) 

af(l) 

at{n) 

0 

0  ... 

0 

at(0)  at(l) 

at(n) 

0  ... 

I  *(1)  1 II 


<  I- 


c° 


i,From  the  above  formulation  continuity  of  the  cost  fj,{0t)  with  respect  to  parameters 
changes  i.e.,  6t  is  easy  to  be  established.  This  does  not  automatically  imply  that  the 
assumptions  1,  2,  3  of  Theorem  5.5.1  cire  satisfied.  What  we  need  is  to  be  continuous 
with  respect  to  9t  and  also  to  have  a  uniform  degree  botmd.  These  requirements  might  not 
be  satisfied  in  this  complete  generality;  for  example  when  the  solution  is  not  unique  then 
continuity  is  immediately  destroyed.  Hence,  additional  assumptions  might  be  needed.  In 
the  case  however,  where  Ab  =  0  this  is  not  needed.  In  this  case,  the  problem  becomes 


inf_  _  _  II  Aj 

Ct4i  stabilizing 


-1 


(l  +  PtCt+i) 


-ll 
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As  shown  in  [7]  the  finite  dimensionality  of  the  LTI  system  Pj,  the  compactness  of  © 
together  with  the  properties  of  the  optimed  solution  serve  to  satisfy  assumptions  1,2,3 
of  Theorem  5.5.JL.  For  assumption  4  to  hold  the  following  condition  suffices: 


3e  >  0  :  /iA  sn-pfiA{d)  <  -  e  (C). 

96©  -OaiI  +  t/) 

Note  that  <  oo  since  Pe  is  finite  dimensional  and  0  is  compact.  Conversely,  from 
the  above  condition  we  can  evaluate  the  boimd  Da  of  11^^11  for  which  the  indirect 
adaptive  scheme  guarantees  stability.  Namely, 


Da  <  —  . 

This  is  so  because  then  there  are  e,  77  >  0  so  that  condition  (C)  holds.  We  should 
emphasize  that,  pertaining  to  this  particular  class  of  indirect  adaptive  controllers,  the 
fi  adaptive  scheme  provides  the  greatest  upper  bound  on  the  size  of  IIA^H  namely 
for  which  stability  is  guaranteed.  We  do  not  however  claim  that  this  adaptive  scheme 
is  the  optimal  one.  Also  note  that  even  if  Ab  =  0  the  plant  model  captures  a  wide 
class  of  uncertain  systems.  Finally,  we  should  stress  that  in  the  case  where  Ab  7^  0 
if  the  continuity  assumptions  are  satisfied  then  a  bound  on  Da  for  which  stability  is 
guaranteed  is 

Da  <  - • 

supee® 


5.6  Conclusions 


In  this  chapter  we  presented  a  £^0  to  foo  performance  result  in  the  case  of  slowly  time 
varying  systems.  We  showed  that  the  performance  of  a  slowly  varying  system  cannot 
be  much  worse  than  that  of  the  frozen  time  systems.  Our  approach  was  an  inpiit- 
output  approach  established  in  [6].  We  utilized  this  result  to  characterize  a  class  of 
adaptive  indirect  controllers  t  hat  stabilize  a  time  invariant  system  which  is  subjected  to 
both  parametric  and  imstructured  uncertainty.  Also,  among  a  class  of  indirect  adaptive 
controllers,  we  proposed  an  indirect  adaptive  scheme  that  provides  the  greatest  upper 
boimd  on  the  size  of  unstructured  uncertainty  for  which  stability  is  guaranteed. 
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